2024-03-24T10:24:51.630 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-24T10:24:51.631 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066 --name pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/orig.config.yaml 2024-03-24T10:24:51.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:24:51.765 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066 branch: wip-batrick-testing-20240323.003144-squid description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} email: pdonnell@redhat.com first_in_suite: false job_id: '7619066' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false machine_type: smithi name: pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-batrick-testing-20240323.003144-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 21b3bd672163092b4e542f772797fcba02d3d4de ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 21b3bd672163092b4e542f772797fcba02d3d4de kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240323.003144-squid sha1: d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 4284 sha1: 21b3bd672163092b4e542f772797fcba02d3d4de sleep_before_teardown: 0 subset: 405/512 suite: fs suite_branch: wip-batrick-testing-20240323.003144-squid suite_path: /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqk9dATlwXy+rpqjN9Zyphqkl/rDchGeil0qHop71DGM9B989yvP/j18Vi+8MqKL+Rop/wRYfvol2AzB2Tg1k= smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWTV2diAXT+1yBgPlwwayXBRwwHcaQB0sLIXPCoYIUakDfA6u5A1a9ASmgoVG0TpRRKyUf9YeXhqnFR1Q1zqCM= tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing nautilus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client nautilus - print: '**** done ceph' - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_newops teuthology: branch: nautilus fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() or syntax_version() == 'v2' then reject() end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-24_04:56:01 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-24T10:24:51.766 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa; will attempt to use it 2024-03-24T10:24:51.766 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa/tasks 2024-03-24T10:24:51.766 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-24T10:24:51.768 INFO:teuthology.task.internal:Checking packages... 2024-03-24T10:24:51.790 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '21b3bd672163092b4e542f772797fcba02d3d4de' 2024-03-24T10:24:51.790 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:24:51.790 INFO:teuthology.packaging:ref: None 2024-03-24T10:24:51.791 INFO:teuthology.packaging:tag: None 2024-03-24T10:24:51.791 INFO:teuthology.packaging:branch: wip-batrick-testing-20240323.003144-squid 2024-03-24T10:24:51.791 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:24:51.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20240323.003144-squid 2024-03-24T10:24:51.929 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1855.g21b3bd67 2024-03-24T10:24:51.930 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-24T10:24:51.937 INFO:teuthology.task.internal:no buildpackages task found 2024-03-24T10:24:51.937 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-24T10:24:51.957 INFO:teuthology.task.internal:Saving configuration 2024-03-24T10:24:51.972 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-24T10:24:51.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T10:24:52.005 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.530637', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqk9dATlwXy+rpqjN9Zyphqkl/rDchGeil0qHop71DGM9B989yvP/j18Vi+8MqKL+Rop/wRYfvol2AzB2Tg1k='} 2024-03-24T10:24:52.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.532290', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWTV2diAXT+1yBgPlwwayXBRwwHcaQB0sLIXPCoYIUakDfA6u5A1a9ASmgoVG0TpRRKyUf9YeXhqnFR1Q1zqCM='} 2024-03-24T10:24:52.037 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-24T10:24:52.064 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-03-24T10:24:52.064 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['client.0'] 2024-03-24T10:24:52.064 INFO:teuthology.run_tasks:Running task console_log... 2024-03-24T10:24:52.156 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae4e272f70>, signals=[15]) 2024-03-24T10:24:52.156 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-24T10:24:52.163 INFO:teuthology.task.internal:Opening connections... 2024-03-24T10:24:52.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:24:52.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:24:52.238 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-03-24T10:24:52.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:24:52.310 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-24T10:24:52.316 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-03-24T10:24:52.340 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-03-24T10:24:52.340 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-03-24T10:24:52.401 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-03-24T10:24:52.401 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2024-03-24T10:24:52.401 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-03-24T10:24:52.401 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:24:52.401 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-24T10:24:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:24:52.403 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-03-24T10:24:52.422 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-03-24T10:24:52.443 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-03-24T10:24:52.443 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2024-03-24T10:24:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-24T10:24:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:24:52.504 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-03-24T10:24:52.521 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-24T10:24:52.532 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-24T10:24:52.554 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-24T10:24:52.554 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-03-24T10:24:52.556 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-03-24T10:24:52.576 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-24T10:24:52.582 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-24T10:24:52.582 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-03-24T10:24:52.618 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-03-24T10:24:52.646 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-24T10:24:52.688 INFO:teuthology.run_tasks:Running task kernel... 2024-03-24T10:24:52.730 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-24T10:24:52.733 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-24T10:24:52.733 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-24T10:24:52.734 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-24T10:24:52.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:24:52.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-03-24T10:24:53.055 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-24T10:24:53.055 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-24T10:24:53.056 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-03-24T10:24:53.076 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-489.el8.x86_64 2024-03-24T10:24:53.076 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-24T10:24:53.077 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-24T10:24:53.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum upgrade -y linux-firmware 2024-03-24T10:25:01.309 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - AppStream 4.8 MB/s | 28 MB 00:05 2024-03-24T10:25:08.629 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - BaseOS 4.3 MB/s | 10 MB 00:02 2024-03-24T10:25:10.487 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras 70 kB/s | 18 kB 00:00 2024-03-24T10:25:10.746 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras common packages 50 kB/s | 7.5 kB 00:00 2024-03-24T10:25:11.131 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2024-03-24T10:25:14.599 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 16 MB 00:03 2024-03-24T10:25:18.374 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 381 kB/s | 24 kB 00:00 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repo Size 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-03-24T10:25:21.558 INFO:teuthology.orchestra.run.smithi078.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 1 Package 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 355 M 2024-03-24T10:25:21.559 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-03-24T10:25:34.400 INFO:teuthology.orchestra.run.smithi078.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 28 MB/s | 355 MB 00:12 2024-03-24T10:25:34.400 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:25:34.400 INFO:teuthology.orchestra.run.smithi078.stdout:Total 28 MB/s | 355 MB 00:12 2024-03-24T10:25:36.518 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-03-24T10:25:36.577 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-03-24T10:25:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-03-24T10:25:38.906 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-03-24T10:25:38.929 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-03-24T10:26:01.745 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-03-24T10:26:02.087 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-03-24T10:26:02.308 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-03-24T10:26:02.551 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-03-24T10:26:02.551 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:26:03.025 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-03-24T10:26:03.204 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-24T10:26:03.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-24T10:26:03.347 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/8/flavors/default/x86_64/ 2024-03-24T10:26:03.348 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/8/flavors/default/x86_64/ --input-file=- 2024-03-24T10:26:03.350 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2024-03-24T10:26:16.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24 10:26:16 URL:https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/8/flavors/default/x86_64/kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm [401601496/401601496] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-24T10:26:16.971 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2024-03-24 10:26:16-- 2024-03-24T10:26:16.971 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 14s 2024-03-24T10:26:16.972 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 383M in 13s (28.8 MB/s) 2024-03-24T10:26:16.974 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-24T10:26:16.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-24T10:26:18.744 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying... ######################################## 2024-03-24T10:26:18.788 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing... ######################################## 2024-03-24T10:26:18.898 INFO:teuthology.orchestra.run.smithi078.stdout:Updating / installing... 2024-03-24T10:26:59.773 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-6.8.0_g5ec3e6e88b2e-1 ######################################## 2024-03-24T10:27:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-24T10:27:21.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-24T10:27:21.803 DEBUG:teuthology.orchestra.run.smithi078:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/System.map 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/config 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto 2024-03-24T10:27:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-24T10:27:21.865 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-24T10:27:21.866 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-24T10:27:21.867 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-24T10:27:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-24T10:27:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/custom_method.ko 2024-03-24T10:27:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ata_generic.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-24T10:27:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-24T10:27:21.872 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-24T10:27:21.873 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sis.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-24T10:27:21.874 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma 2024-03-24T10:27:21.875 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/brd.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/loop.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-24T10:27:21.876 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/virtio_blk.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkfront.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi 2024-03-24T10:27:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-24T10:27:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/uv_mmtimer.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/virtio_console.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-24T10:27:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-24T10:27:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-24T10:27:21.881 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/edd.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-24T10:27:21.882 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-24T10:27:21.883 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-24T10:27:21.884 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-24T10:27:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-24T10:27:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-24T10:27:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-24T10:27:21.888 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-24T10:27:21.889 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-24T10:27:21.890 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-24T10:27:21.891 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-24T10:27:21.892 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-24T10:27:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-24T10:27:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-24T10:27:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-24T10:27:21.896 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-24T10:27:21.897 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-24T10:27:21.898 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-dev.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-24T10:27:21.899 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-24T10:27:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt 2024-03-24T10:27:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-24T10:27:21.902 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-24T10:27:21.903 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-24T10:27:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-24T10:27:21.905 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message 2024-03-24T10:27:21.906 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mfd-core.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-24T10:27:21.907 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-24T10:27:21.908 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-24T10:27:21.909 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-24T10:27:21.910 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-24T10:27:21.911 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-24T10:27:21.912 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-24T10:27:21.913 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-24T10:27:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-24T10:27:21.915 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-24T10:27:21.916 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-24T10:27:21.917 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi 2024-03-24T10:27:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-24T10:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis 2024-03-24T10:27:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-24T10:27:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom 2024-03-24T10:27:21.922 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-24T10:27:21.923 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/net_failover.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-24T10:27:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/dp83640.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-24T10:27:21.925 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slhc.ko 2024-03-24T10:27:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tun.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/virtio_net.ko 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3 2024-03-24T10:27:21.927 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netfront.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-24T10:27:21.928 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-24T10:27:21.929 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-24T10:27:21.930 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-24T10:27:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc 2024-03-24T10:27:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-24T10:27:21.933 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-24T10:27:21.934 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx 2024-03-24T10:27:21.935 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-24T10:27:21.936 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-24T10:27:21.937 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-24T10:27:21.938 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid 2024-03-24T10:27:21.939 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx 2024-03-24T10:27:21.940 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-24T10:27:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-24T10:27:21.942 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-24T10:27:21.943 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-24T10:27:21.944 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-24T10:27:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host 2024-03-24T10:27:21.946 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-24T10:27:21.947 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-24T10:27:21.948 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-24T10:27:21.949 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-24T10:27:21.950 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-24T10:27:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-24T10:27:21.952 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost 2024-03-24T10:27:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-24T10:27:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_ring.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-24T10:27:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-24T10:27:21.956 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-24T10:27:21.957 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs 2024-03-24T10:27:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-24T10:27:21.959 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/fat.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/vfat.ko 2024-03-24T10:27:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/fuse.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-24T10:27:21.961 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-24T10:27:21.962 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-24T10:27:21.963 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-24T10:27:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-24T10:27:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-24T10:27:21.966 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs 2024-03-24T10:27:21.967 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs 2024-03-24T10:27:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu/rcutorture.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-24T10:27:21.969 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/asn1_encoder.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-24T10:27:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd/zstd_compress.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-24T10:27:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q 2024-03-24T10:27:21.972 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-24T10:27:21.973 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-24T10:27:21.974 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/failover.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-24T10:27:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-24T10:27:21.976 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-24T10:27:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-24T10:27:21.978 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-24T10:27:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-24T10:27:21.980 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-24T10:27:21.981 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-24T10:27:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-24T10:27:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-24T10:27:21.984 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs 2024-03-24T10:27:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-24T10:27:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-24T10:27:21.987 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-24T10:27:21.988 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-24T10:27:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_quota.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tunnel.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-24T10:27:21.990 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-24T10:27:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-24T10:27:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-24T10:27:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-24T10:27:21.994 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-24T10:27:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-24T10:27:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-24T10:27:21.997 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-24T10:27:21.998 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-24T10:27:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm 2024-03-24T10:27:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-24T10:27:22.001 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-24T10:27:22.002 INFO:teuthology.orchestra.run.smithi078.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-24T10:27:22.006 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:22.006 DEBUG:teuthology.orchestra.run.smithi078:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:postinstall scriptlet (using /bin/sh): 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout: /usr/bin/kernel-install add 6.8.0-g5ec3e6e88b2e /lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:fi 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:for file in vmlinuz System.map config; do 2024-03-24T10:27:22.032 INFO:teuthology.orchestra.run.smithi078.stdout: if ! cmp --silent "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e"; then 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout: cp "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e" 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout: fi 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:done 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:new-kernel-pkg --remove 6.8.0-g5ec3e6e88b2e --rminitrd --initrdfile=/boot/initramfs-6.8.0-g5ec3e6e88b2e.img 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-install remove 6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:fi 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/update-bootloader --remove 6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:22.033 INFO:teuthology.orchestra.run.smithi078.stdout:fi 2024-03-24T10:27:22.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.02 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 129.el8 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-03-24T10:27:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Group : System Environment/Base 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 9265586 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Relocations : (not relocatable) 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : CentOS BuildSystem 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-03-24T10:27:22.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:27:22.112 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-03-24T10:27:22.113 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-24T10:27:22.113 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:22.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-24T10:27:27.837 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-03-24T10:27:29.686 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-03-24T10:27:29.687 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-03-24T10:27:29.713 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Or2pIujGuv 2024-03-24T10:27:29.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Or2pIujGuv 2024-03-24T10:27:29.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.Or2pIujGuv 2024-03-24T10:27:29.949 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.Or2pIujGuv is 6KB 2024-03-24T10:27:29.998 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.Or2pIujGuv 2024-03-24T10:27:30.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-03-24T10:27:30.081 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-24T10:27:30.082 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-24T10:27:30.082 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-24T10:27:30.082 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-6.8.0-g5ec3e6e88b2e.conf 2024-03-24T10:27:30.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.8.0-g5ec3e6e88b2e 2024-03-24T10:27:30.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-03-24T10:28:00.252 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-24T10:28:00.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-24T10:28:00.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:29:00.255 DEBUG:teuthology.orchestra.remote:timed out 2024-03-24T10:29:09.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-24T10:29:09.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:29:09.660 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-03-24T10:29:10.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-24T10:29:10.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g5ec3e6e88b2e"... 2024-03-24T10:29:10.173 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-03-24T10:29:10.215 INFO:teuthology.orchestra.run.smithi078.stdout:6.8.0-g5ec3e6e88b2e 2024-03-24T10:29:10.215 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-24T10:29:10.215 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-24T10:29:10.215 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-24T10:29:11.219 DEBUG:teuthology.parallel:result is None 2024-03-24T10:29:11.219 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-24T10:29:11.228 INFO:teuthology.task.internal:Creating test directory... 2024-03-24T10:29:11.228 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-24T10:29:11.231 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-24T10:29:11.280 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-24T10:29:11.286 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-24T10:29:11.292 INFO:teuthology.task.internal:Creating archive directory... 2024-03-24T10:29:11.293 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-24T10:29:11.295 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-24T10:29:11.379 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-24T10:29:11.385 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-24T10:29:11.386 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-24T10:29:11.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:29:11.407 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-24T10:29:11.450 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-24T10:29:11.489 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:29:11.507 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:29:11.584 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:29:11.630 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:29:11.633 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-24T10:29:11.641 INFO:teuthology.task.internal:Configuring sudo... 2024-03-24T10:29:11.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-24T10:29:11.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-24T10:29:11.710 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-24T10:29:11.720 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-24T10:29:11.720 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-24T10:29:11.723 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-24T10:29:11.766 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:29:11.827 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:29:11.881 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:29:11.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:29:12.010 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:29:12.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-24T10:29:12.080 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:29:12.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:29:12.226 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:29:12.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:29:12.365 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:29:12.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-24T10:29:12.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-03-24T10:29:12.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-03-24T10:29:12.505 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:29:12.625 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:29:12.954 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-24T10:29:12.963 INFO:teuthology.task.internal:Starting timer... 2024-03-24T10:29:12.963 INFO:teuthology.run_tasks:Running task pcp... 2024-03-24T10:29:13.004 INFO:teuthology.run_tasks:Running task selinux... 2024-03-24T10:29:13.014 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-24T10:29:13.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-03-24T10:29:13.098 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-03-24T10:29:13.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-03-24T10:29:13.215 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-03-24T10:29:13.219 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-24T10:29:13.219 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-03-24T10:29:13.254 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-03-24T10:29:13.254 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-03-24T10:29:13.321 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-03-24T10:29:13.321 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive'} 2024-03-24T10:29:13.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-24T10:29:13.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:29:13.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-24T10:29:13.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:29:13.419 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-24T10:29:13.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-03-24T10:29:13.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-03-24T10:29:13.517 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-24T10:29:13.527 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-24T10:29:13.549 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-24T10:29:13.550 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-24T10:36:31.718 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2024-03-24T10:36:31.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-24T10:36:31.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:36:31.806 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-24T10:36:31.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-24T10:36:31.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:36:31.981 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-03-24T10:36:32.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-24T10:36:32.094 INFO:teuthology.run_tasks:Running task clock... 2024-03-24T10:36:32.105 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-24T10:36:32.105 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-24T10:36:32.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:36:32.109 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-24T10:36:32.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:36:32.141 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-24T10:36:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-24T10:36:32.204 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-24T10:36:32.221 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-03-24T10:36:32.232 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-03-24T10:36:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-24T10:36:32.246 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-24T10:36:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-24T10:36:32.322 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-03-24T10:36:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.334 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.349 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-03-24T10:36:32.380 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-24T10:36:32.410 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-24T10:36:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2024-03-24T10:36:32.497 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:36:32.498 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-03-24T10:36:32.498 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.498 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.498 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.498 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:36:32.499 INFO:teuthology.run_tasks:Running task install... 2024-03-24T10:36:32.508 DEBUG:teuthology.task.install:project ceph 2024-03-24T10:36:32.508 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}} 2024-03-24T10:36:32.508 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'} 2024-03-24T10:36:32.508 INFO:teuthology.task.install:Using flavor: default 2024-03-24T10:36:32.514 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-24T10:36:32.514 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2024-03-24T10:36:32.515 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'tag': None, 'wait_for_package': False} 2024-03-24T10:36:32.515 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:36:32.515 INFO:teuthology.packaging:ref: None 2024-03-24T10:36:32.515 INFO:teuthology.packaging:tag: None 2024-03-24T10:36:32.515 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:36:32.515 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:36:32.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-03-24T10:36:32.517 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'tag': None, 'wait_for_package': False} 2024-03-24T10:36:32.517 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:36:32.517 INFO:teuthology.packaging:ref: None 2024-03-24T10:36:32.517 INFO:teuthology.packaging:tag: None 2024-03-24T10:36:32.518 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:36:32.518 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:36:32.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-03-24T10:36:32.839 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-03-24T10:36:32.839 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-03-24T10:36:32.852 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-03-24T10:36:32.852 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-03-24T10:36:32.878 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-24T10:36:32.878 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:36:32.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-24T10:36:32.895 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-24T10:36:32.895 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:36:32.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-24T10:36:32.907 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-03-24T10:36:32.907 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:36:32.907 INFO:teuthology.packaging:ref: None 2024-03-24T10:36:32.908 INFO:teuthology.packaging:tag: None 2024-03-24T10:36:32.908 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:36:32.908 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:36:32.908 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-24T10:36:32.961 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-03-24T10:36:32.962 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:36:32.962 INFO:teuthology.packaging:ref: None 2024-03-24T10:36:32.962 INFO:teuthology.packaging:tag: None 2024-03-24T10:36:32.962 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:36:32.962 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:36:32.963 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-24T10:36:32.977 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-24T10:36:33.055 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-24T10:36:33.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-24T10:36:33.121 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-03-24T10:36:33.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-03-24T10:36:33.161 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-24T10:36:33.226 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-03-24T10:36:33.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi073.stdout:76 files removed 2024-03-24T10:36:33.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-03-24T10:36:33.568 INFO:teuthology.orchestra.run.smithi078.stdout:76 files removed 2024-03-24T10:36:33.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-03-24T10:36:33.914 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 538 kB/s | 65 kB 00:00 2024-03-24T10:36:34.090 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 80 kB/s | 11 kB 00:00 2024-03-24T10:36:34.232 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 14 kB/s | 1.7 kB 00:00 2024-03-24T10:36:34.271 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 472 kB/s | 65 kB 00:00 2024-03-24T10:36:34.389 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 138 kB/s | 11 kB 00:00 2024-03-24T10:36:34.490 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 23 kB/s | 1.7 kB 00:00 2024-03-24T10:36:39.123 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - AppStream 5.7 MB/s | 28 MB 00:04 2024-03-24T10:36:41.889 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - AppStream 3.8 MB/s | 28 MB 00:07 2024-03-24T10:36:45.499 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - BaseOS 7.7 MB/s | 10 MB 00:01 2024-03-24T10:36:47.408 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras 74 kB/s | 18 kB 00:00 2024-03-24T10:36:47.667 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras common packages 50 kB/s | 7.5 kB 00:00 2024-03-24T10:36:48.474 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - BaseOS 7.8 MB/s | 10 MB 00:01 2024-03-24T10:36:49.077 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - PowerTools 3.7 MB/s | 4.9 MB 00:01 2024-03-24T10:36:50.128 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2024-03-24T10:36:50.533 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-03-24T10:36:50.933 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 7.5 kB 00:00 2024-03-24T10:36:51.824 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-03-24T10:36:52.326 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - PowerTools 3.8 MB/s | 4.9 MB 00:01 2024-03-24T10:36:53.419 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-03-24T10:36:55.647 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2024-03-24T10:36:55.738 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 420 kB/s | 24 kB 00:00 2024-03-24T10:36:59.303 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-03-24T10:36:59.303 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-03-24T10:36:59.322 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-03-24T10:36:59.322 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-03-24T10:36:59.323 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-03-24T10:36:59.394 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-24T10:36:59.405 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-24T10:36:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-03-24T10:36:59.407 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-03-24T10:36:59.408 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-24T10:36:59.409 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-03-24T10:36:59.410 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-03-24T10:36:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-24T10:36:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-24T10:36:59.413 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-24T10:36:59.414 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-24T10:36:59.415 INFO:teuthology.orchestra.run.smithi073.stdout:Install 102 Packages 2024-03-24T10:36:59.416 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 19 Packages 2024-03-24T10:36:59.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:36:59.416 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 166 M 2024-03-24T10:36:59.416 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-24T10:36:59.915 INFO:teuthology.orchestra.run.smithi073.stdout:(1/121): ceph-14.2.22-0.el8.x86_64.rpm 80 kB/s | 6.3 kB 00:00 2024-03-24T10:37:00.137 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 417 kB/s | 24 kB 00:00 2024-03-24T10:37:00.406 INFO:teuthology.orchestra.run.smithi073.stdout:(2/121): ceph-base-14.2.22-0.el8.x86_64.rpm 9.4 MB/s | 5.4 MB 00:00 2024-03-24T10:37:00.431 INFO:teuthology.orchestra.run.smithi073.stdout:(3/121): ceph-fuse-14.2.22-0.el8.x86_64.rpm 1.1 MB/s | 590 kB 00:00 2024-03-24T10:37:00.657 INFO:teuthology.orchestra.run.smithi073.stdout:(4/121): ceph-common-14.2.22-0.el8.x86_64.rpm 24 MB/s | 19 MB 00:00 2024-03-24T10:37:00.707 INFO:teuthology.orchestra.run.smithi073.stdout:(5/121): ceph-mds-14.2.22-0.el8.x86_64.rpm 6.6 MB/s | 2.0 MB 00:00 2024-03-24T10:37:00.741 INFO:teuthology.orchestra.run.smithi073.stdout:(6/121): ceph-mgr-14.2.22-0.el8.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-03-24T10:37:01.258 INFO:teuthology.orchestra.run.smithi073.stdout:(7/121): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-03-24T10:37:01.365 INFO:teuthology.orchestra.run.smithi073.stdout:(8/121): ceph-mon-14.2.22-0.el8.x86_64.rpm 6.3 MB/s | 4.5 MB 00:00 2024-03-24T10:37:01.393 INFO:teuthology.orchestra.run.smithi073.stdout:(9/121): ceph-selinux-14.2.22-0.el8.x86_64.rpm 186 kB/s | 25 kB 00:00 2024-03-24T10:37:01.584 INFO:teuthology.orchestra.run.smithi073.stdout:(10/121): ceph-osd-14.2.22-0.el8.x86_64.rpm 19 MB/s | 17 MB 00:00 2024-03-24T10:37:01.601 INFO:teuthology.orchestra.run.smithi073.stdout:(11/121): libcephfs-devel-14.2.22-0.el8.x86_64. 103 kB/s | 22 kB 00:00 2024-03-24T10:37:01.634 INFO:teuthology.orchestra.run.smithi073.stdout:(12/121): libcephfs2-14.2.22-0.el8.x86_64.rpm 10 MB/s | 520 kB 00:00 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi073.stdout:(13/121): librados-devel-14.2.22-0.el8.x86_64.r 1.5 MB/s | 90 kB 00:00 2024-03-24T10:37:01.694 INFO:teuthology.orchestra.run.smithi073.stdout:(14/121): libradosstriper1-14.2.22-0.el8.x86_64 6.3 MB/s | 376 kB 00:00 2024-03-24T10:37:01.835 INFO:teuthology.orchestra.run.smithi073.stdout:(15/121): librgw2-14.2.22-0.el8.x86_64.rpm 30 MB/s | 5.3 MB 00:00 2024-03-24T10:37:01.852 INFO:teuthology.orchestra.run.smithi073.stdout:(16/121): python3-ceph-argparse-14.2.22-0.el8.x 248 kB/s | 39 kB 00:00 2024-03-24T10:37:01.919 INFO:teuthology.orchestra.run.smithi073.stdout:(17/121): python3-cephfs-14.2.22-0.el8.x86_64.r 1.9 MB/s | 159 kB 00:00 2024-03-24T10:37:01.953 INFO:teuthology.orchestra.run.smithi073.stdout:(18/121): python3-rados-14.2.22-0.el8.x86_64.rp 3.2 MB/s | 323 kB 00:00 2024-03-24T10:37:01.982 INFO:teuthology.orchestra.run.smithi073.stdout:(19/121): python3-rbd-14.2.22-0.el8.x86_64.rpm 4.8 MB/s | 291 kB 00:00 2024-03-24T10:37:02.012 INFO:teuthology.orchestra.run.smithi073.stdout:(20/121): python3-rgw-14.2.22-0.el8.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2024-03-24T10:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout:(21/121): rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.2 MB/s | 73 kB 00:00 2024-03-24T10:37:02.129 INFO:teuthology.orchestra.run.smithi073.stdout:(22/121): rbd-mirror-14.2.22-0.el8.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2024-03-24T10:37:02.154 INFO:teuthology.orchestra.run.smithi073.stdout:(23/121): rbd-nbd-14.2.22-0.el8.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2024-03-24T10:37:02.171 INFO:teuthology.orchestra.run.smithi073.stdout:(24/121): ceph-grafana-dashboards-14.2.22-0.el8 577 kB/s | 24 kB 00:00 2024-03-24T10:37:02.255 INFO:teuthology.orchestra.run.smithi073.stdout:(25/121): ceph-mgr-dashboard-14.2.22-0.el8.noar 37 MB/s | 3.7 MB 00:00 2024-03-24T10:37:02.297 INFO:teuthology.orchestra.run.smithi073.stdout:(26/121): ceph-mgr-diskprediction-local-14.2.22 8.9 MB/s | 1.1 MB 00:00 2024-03-24T10:37:02.322 INFO:teuthology.orchestra.run.smithi073.stdout:(27/121): ceph-mgr-rook-14.2.22-0.el8.noarch.rp 229 kB/s | 15 kB 00:00 2024-03-24T10:37:02.748 INFO:teuthology.orchestra.run.smithi073.stdout:(28/121): ceph-test-14.2.22-0.el8.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-03-24T10:37:02.914 INFO:teuthology.orchestra.run.smithi073.stdout:(29/121): flex-2.6.1-9.el8.x86_64.rpm 540 kB/s | 320 kB 00:00 2024-03-24T10:37:03.198 INFO:teuthology.orchestra.run.smithi073.stdout:(30/121): bison-3.0.4-10.el8.x86_64.rpm 764 kB/s | 688 kB 00:00 2024-03-24T10:37:03.223 INFO:teuthology.orchestra.run.smithi073.stdout:(31/121): jq-1.6-8.el8.x86_64.rpm 427 kB/s | 203 kB 00:00 2024-03-24T10:37:03.424 INFO:teuthology.orchestra.run.smithi073.stdout:(32/121): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-03-24T10:37:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:(33/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 971 kB/s | 259 kB 00:00 2024-03-24T10:37:03.499 INFO:teuthology.orchestra.run.smithi073.stdout:(34/121): oniguruma-6.8.2-3.el8.x86_64.rpm 682 kB/s | 188 kB 00:00 2024-03-24T10:37:03.675 INFO:teuthology.orchestra.run.smithi073.stdout:(35/121): python3-mako-1.0.6-14.el8.noarch.rpm 897 kB/s | 157 kB 00:00 2024-03-24T10:37:03.775 INFO:teuthology.orchestra.run.smithi073.stdout:(36/121): python3-markupsafe-0.23-19.el8.x86_64 387 kB/s | 39 kB 00:00 2024-03-24T10:37:03.792 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-03-24T10:37:03.792 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-03-24T10:37:03.811 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-03-24T10:37:03.811 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-03-24T10:37:03.812 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-03-24T10:37:03.884 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-03-24T10:37:03.896 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-03-24T10:37:03.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-03-24T10:37:03.898 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-03-24T10:37:03.899 INFO:teuthology.orchestra.run.smithi078.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-03-24T10:37:03.900 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-03-24T10:37:03.901 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-03-24T10:37:03.902 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-24T10:37:03.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-03-24T10:37:03.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-03-24T10:37:03.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout:Install 102 Packages 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 19 Packages 2024-03-24T10:37:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:37:03.908 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 166 M 2024-03-24T10:37:03.908 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-03-24T10:37:05.150 INFO:teuthology.orchestra.run.smithi073.stdout:(37/121): openblas-0.3.15-4.el8.x86_64.rpm 2.7 MB/s | 4.7 MB 00:01 2024-03-24T10:37:05.225 INFO:teuthology.orchestra.run.smithi073.stdout:(38/121): openblas-threads-0.3.15-4.el8.x86_64. 2.8 MB/s | 4.9 MB 00:01 2024-03-24T10:37:05.251 INFO:teuthology.orchestra.run.smithi073.stdout:(39/121): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2024-03-24T10:37:05.305 INFO:teuthology.orchestra.run.smithi078.stdout:(1/121): ceph-14.2.22-0.el8.x86_64.rpm 110 kB/s | 6.3 kB 00:00 2024-03-24T10:37:05.338 INFO:teuthology.orchestra.run.smithi078.stdout:(2/121): ceph-fuse-14.2.22-0.el8.x86_64.rpm 17 MB/s | 590 kB 00:00 2024-03-24T10:37:05.341 INFO:teuthology.orchestra.run.smithi073.stdout:(40/121): python3-prettytable-0.7.2-14.el8.noar 379 kB/s | 44 kB 00:00 2024-03-24T10:37:05.376 INFO:teuthology.orchestra.run.smithi073.stdout:(41/121): python3-pyOpenSSL-19.0.0-1.el8.noarch 826 kB/s | 103 kB 00:00 2024-03-24T10:37:05.406 INFO:teuthology.orchestra.run.smithi078.stdout:(3/121): ceph-mds-14.2.22-0.el8.x86_64.rpm 30 MB/s | 2.0 MB 00:00 2024-03-24T10:37:05.435 INFO:teuthology.orchestra.run.smithi073.stdout:(42/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2024-03-24T10:37:05.468 INFO:teuthology.orchestra.run.smithi073.stdout:(43/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2024-03-24T10:37:05.472 INFO:teuthology.orchestra.run.smithi078.stdout:(4/121): ceph-mgr-14.2.22-0.el8.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-03-24T10:37:05.519 INFO:teuthology.orchestra.run.smithi073.stdout:(44/121): python3-pytz-2017.2-11.el8.noarch.rpm 683 kB/s | 57 kB 00:00 2024-03-24T10:37:05.573 INFO:teuthology.orchestra.run.smithi078.stdout:(5/121): ceph-base-14.2.22-0.el8.x86_64.rpm 16 MB/s | 5.4 MB 00:00 2024-03-24T10:37:05.577 INFO:teuthology.orchestra.run.smithi073.stdout:(45/121): python3-numpy-1.14.3-10.el8.x86_64.rp 2.1 MB/s | 3.7 MB 00:01 2024-03-24T10:37:05.681 INFO:teuthology.orchestra.run.smithi078.stdout:(6/121): ceph-mon-14.2.22-0.el8.x86_64.rpm 21 MB/s | 4.5 MB 00:00 2024-03-24T10:37:05.707 INFO:teuthology.orchestra.run.smithi073.stdout:(46/121): python3-werkzeug-0.12.2-4.el8.noarch. 2.4 MB/s | 457 kB 00:00 2024-03-24T10:37:05.745 INFO:teuthology.orchestra.run.smithi073.stdout:(47/121): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi073.stdout:(48/121): xmlstarlet-1.6.1-20.el8.x86_64.rpm 803 kB/s | 71 kB 00:00 2024-03-24T10:37:05.848 INFO:teuthology.orchestra.run.smithi078.stdout:(7/121): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 36 MB/s | 6.0 MB 00:00 2024-03-24T10:37:05.874 INFO:teuthology.orchestra.run.smithi078.stdout:(8/121): ceph-selinux-14.2.22-0.el8.x86_64.rpm 998 kB/s | 25 kB 00:00 2024-03-24T10:37:06.095 INFO:teuthology.orchestra.run.smithi073.stdout:(49/121): elfutils-libelf-devel-0.190-2.el8.x86 178 kB/s | 62 kB 00:00 2024-03-24T10:37:06.140 INFO:teuthology.orchestra.run.smithi078.stdout:(9/121): ceph-common-14.2.22-0.el8.x86_64.rpm 22 MB/s | 19 MB 00:00 2024-03-24T10:37:06.157 INFO:teuthology.orchestra.run.smithi078.stdout:(10/121): libcephfs-devel-14.2.22-0.el8.x86_64. 1.3 MB/s | 22 kB 00:00 2024-03-24T10:37:06.187 INFO:teuthology.orchestra.run.smithi073.stdout:(50/121): fuse-2.9.7-19.el8.x86_64.rpm 212 kB/s | 83 kB 00:00 2024-03-24T10:37:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:(11/121): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2024-03-24T10:37:06.216 INFO:teuthology.orchestra.run.smithi078.stdout:(12/121): librados-devel-14.2.22-0.el8.x86_64.r 3.6 MB/s | 90 kB 00:00 2024-03-24T10:37:06.221 INFO:teuthology.orchestra.run.smithi073.stdout:(51/121): keyutils-libs-devel-1.5.10-9.el8.x86_ 384 kB/s | 48 kB 00:00 2024-03-24T10:37:06.250 INFO:teuthology.orchestra.run.smithi078.stdout:(13/121): libradosstriper1-14.2.22-0.el8.x86_64 11 MB/s | 376 kB 00:00 2024-03-24T10:37:06.346 INFO:teuthology.orchestra.run.smithi073.stdout:(52/121): libcom_err-devel-1.45.6-5.el8.x86_64. 310 kB/s | 39 kB 00:00 2024-03-24T10:37:06.450 INFO:teuthology.orchestra.run.smithi078.stdout:(14/121): ceph-osd-14.2.22-0.el8.x86_64.rpm 19 MB/s | 17 MB 00:00 2024-03-24T10:37:06.475 INFO:teuthology.orchestra.run.smithi078.stdout:(15/121): python3-ceph-argparse-14.2.22-0.el8.x 1.6 MB/s | 39 kB 00:00 2024-03-24T10:37:06.493 INFO:teuthology.orchestra.run.smithi078.stdout:(16/121): python3-cephfs-14.2.22-0.el8.x86_64.r 9.3 MB/s | 159 kB 00:00 2024-03-24T10:37:06.526 INFO:teuthology.orchestra.run.smithi078.stdout:(17/121): python3-rados-14.2.22-0.el8.x86_64.rp 9.5 MB/s | 323 kB 00:00 2024-03-24T10:37:06.538 INFO:teuthology.orchestra.run.smithi073.stdout:(53/121): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2024-03-24T10:37:06.560 INFO:teuthology.orchestra.run.smithi078.stdout:(18/121): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.6 MB/s | 291 kB 00:00 2024-03-24T10:37:06.585 INFO:teuthology.orchestra.run.smithi078.stdout:(19/121): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-03-24T10:37:06.611 INFO:teuthology.orchestra.run.smithi078.stdout:(20/121): rbd-fuse-14.2.22-0.el8.x86_64.rpm 2.9 MB/s | 73 kB 00:00 2024-03-24T10:37:06.647 INFO:teuthology.orchestra.run.smithi073.stdout:(54/121): libquadmath-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2024-03-24T10:37:06.711 INFO:teuthology.orchestra.run.smithi078.stdout:(21/121): librgw2-14.2.22-0.el8.x86_64.rpm 11 MB/s | 5.3 MB 00:00 2024-03-24T10:37:06.722 INFO:teuthology.orchestra.run.smithi073.stdout:(55/121): libgfortran-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2024-03-24T10:37:06.736 INFO:teuthology.orchestra.run.smithi078.stdout:(22/121): rbd-nbd-14.2.22-0.el8.x86_64.rpm 5.6 MB/s | 142 kB 00:00 2024-03-24T10:37:06.739 INFO:teuthology.orchestra.run.smithi073.stdout:(56/121): librabbitmq-0.9.0-5.el8.x86_64.rpm 513 kB/s | 47 kB 00:00 2024-03-24T10:37:06.778 INFO:teuthology.orchestra.run.smithi078.stdout:(23/121): rbd-mirror-14.2.22-0.el8.x86_64.rpm 14 MB/s | 2.3 MB 00:00 2024-03-24T10:37:06.803 INFO:teuthology.orchestra.run.smithi078.stdout:(24/121): ceph-grafana-dashboards-14.2.22-0.el8 361 kB/s | 24 kB 00:00 2024-03-24T10:37:06.839 INFO:teuthology.orchestra.run.smithi073.stdout:(57/121): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2024-03-24T10:37:06.862 INFO:teuthology.orchestra.run.smithi078.stdout:(25/121): ceph-mgr-diskprediction-local-14.2.22 19 MB/s | 1.1 MB 00:00 2024-03-24T10:37:06.864 INFO:teuthology.orchestra.run.smithi073.stdout:(58/121): libsepol-devel-2.9-3.el8.x86_64.rpm 694 kB/s | 87 kB 00:00 2024-03-24T10:37:06.887 INFO:teuthology.orchestra.run.smithi078.stdout:(26/121): ceph-mgr-rook-14.2.22-0.el8.noarch.rp 621 kB/s | 15 kB 00:00 2024-03-24T10:37:06.940 INFO:teuthology.orchestra.run.smithi073.stdout:(59/121): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2024-03-24T10:37:06.967 INFO:teuthology.orchestra.run.smithi073.stdout:(60/121): libzstd-devel-1.4.4-1.el8.x86_64.rpm 436 kB/s | 44 kB 00:00 2024-03-24T10:37:06.971 INFO:teuthology.orchestra.run.smithi078.stdout:(27/121): ceph-mgr-dashboard-14.2.22-0.el8.noar 19 MB/s | 3.7 MB 00:00 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi073.stdout:(61/121): pcre2-devel-10.32-3.el8.x86_64.rpm 3.0 MB/s | 605 kB 00:00 2024-03-24T10:37:07.292 INFO:teuthology.orchestra.run.smithi073.stdout:(62/121): openssl-devel-1.1.1k-12.el8.x86_64.rp 9.1 MB/s | 3.2 MB 00:00 2024-03-24T10:37:07.316 INFO:teuthology.orchestra.run.smithi073.stdout:(63/121): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2024-03-24T10:37:07.392 INFO:teuthology.orchestra.run.smithi073.stdout:(64/121): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2024-03-24T10:37:07.421 INFO:teuthology.orchestra.run.smithi078.stdout:(28/121): ceph-test-14.2.22-0.el8.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-03-24T10:37:07.434 INFO:teuthology.orchestra.run.smithi073.stdout:(65/121): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2024-03-24T10:37:07.540 INFO:teuthology.orchestra.run.smithi073.stdout:(66/121): python3-cryptography-3.2.1-7.el8.x86_ 4.2 MB/s | 641 kB 00:00 2024-03-24T10:37:07.568 INFO:teuthology.orchestra.run.smithi073.stdout:(67/121): python3-jwt-1.6.1-2.el8.noarch.rpm 318 kB/s | 43 kB 00:00 2024-03-24T10:37:07.643 INFO:teuthology.orchestra.run.smithi073.stdout:(68/121): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-03-24T10:37:07.676 INFO:teuthology.orchestra.run.smithi073.stdout:(69/121): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2024-03-24T10:37:07.780 INFO:teuthology.orchestra.run.smithi078.stdout:(29/121): flex-2.6.1-9.el8.x86_64.rpm 395 kB/s | 320 kB 00:00 2024-03-24T10:37:07.810 INFO:teuthology.orchestra.run.smithi073.stdout:(70/121): python3-scipy-1.0.0-21.module_el8+762 6.1 MB/s | 14 MB 00:02 2024-03-24T10:37:07.827 INFO:teuthology.orchestra.run.smithi073.stdout:(71/121): python3-requests-oauthlib-1.0.0-1.el8 232 kB/s | 43 kB 00:00 2024-03-24T10:37:07.844 INFO:teuthology.orchestra.run.smithi073.stdout:(72/121): zlib-devel-1.2.11-21.el8.x86_64.rpm 347 kB/s | 58 kB 00:00 2024-03-24T10:37:07.880 INFO:teuthology.orchestra.run.smithi078.stdout:(30/121): jq-1.6-8.el8.x86_64.rpm 443 kB/s | 203 kB 00:00 2024-03-24T10:37:07.997 INFO:teuthology.orchestra.run.smithi078.stdout:(31/121): bison-3.0.4-10.el8.x86_64.rpm 620 kB/s | 688 kB 00:01 2024-03-24T10:37:08.122 INFO:teuthology.orchestra.run.smithi078.stdout:(32/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2024-03-24T10:37:08.172 INFO:teuthology.orchestra.run.smithi078.stdout:(33/121): oniguruma-6.8.2-3.el8.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-03-24T10:37:08.203 INFO:teuthology.orchestra.run.smithi073.stdout:(73/121): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2024-03-24T10:37:08.299 INFO:teuthology.orchestra.run.smithi078.stdout:(34/121): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-03-24T10:37:08.320 INFO:teuthology.orchestra.run.smithi073.stdout:(74/121): leveldb-1.22-1.el8.x86_64.rpm 368 kB/s | 181 kB 00:00 2024-03-24T10:37:08.362 INFO:teuthology.orchestra.run.smithi073.stdout:(75/121): gperftools-libs-2.7-9.el8.x86_64.rpm 556 kB/s | 306 kB 00:00 2024-03-24T10:37:08.387 INFO:teuthology.orchestra.run.smithi073.stdout:(76/121): libunwind-1.3.1-3.el8.x86_64.rpm 408 kB/s | 75 kB 00:00 2024-03-24T10:37:08.445 INFO:teuthology.orchestra.run.smithi073.stdout:(77/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 347 kB/s | 44 kB 00:00 2024-03-24T10:37:08.473 INFO:teuthology.orchestra.run.smithi078.stdout:(35/121): python3-mako-1.0.6-14.el8.noarch.rpm 897 kB/s | 157 kB 00:00 2024-03-24T10:37:08.487 INFO:teuthology.orchestra.run.smithi073.stdout:(78/121): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2024-03-24T10:37:08.513 INFO:teuthology.orchestra.run.smithi073.stdout:(79/121): python3-cachetools-3.1.1-4.el8.noarch 262 kB/s | 33 kB 00:00 2024-03-24T10:37:08.546 INFO:teuthology.orchestra.run.smithi073.stdout:(80/121): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2024-03-24T10:37:08.565 INFO:teuthology.orchestra.run.smithi078.stdout:(36/121): python3-markupsafe-0.23-19.el8.x86_64 424 kB/s | 39 kB 00:00 2024-03-24T10:37:08.630 INFO:teuthology.orchestra.run.smithi073.stdout:(81/121): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2024-03-24T10:37:08.664 INFO:teuthology.orchestra.run.smithi073.stdout:(82/121): python3-google-auth-1.1.1-10.el8.noar 695 kB/s | 81 kB 00:00 2024-03-24T10:37:08.731 INFO:teuthology.orchestra.run.smithi073.stdout:(83/121): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-03-24T10:37:08.756 INFO:teuthology.orchestra.run.smithi073.stdout:(84/121): python3-cherrypy-18.4.0-1.el8.noarch. 1.5 MB/s | 384 kB 00:00 2024-03-24T10:37:08.782 INFO:teuthology.orchestra.run.smithi073.stdout:(85/121): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2024-03-24T10:37:08.856 INFO:teuthology.orchestra.run.smithi073.stdout:(86/121): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-03-24T10:37:08.898 INFO:teuthology.orchestra.run.smithi073.stdout:(87/121): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2024-03-24T10:37:08.999 INFO:teuthology.orchestra.run.smithi073.stdout:(88/121): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2024-03-24T10:37:09.024 INFO:teuthology.orchestra.run.smithi073.stdout:(89/121): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2024-03-24T10:37:09.058 INFO:teuthology.orchestra.run.smithi073.stdout:(90/121): python3-kubernetes-11.0.0-6.el8.noarc 3.6 MB/s | 1.2 MB 00:00 2024-03-24T10:37:09.108 INFO:teuthology.orchestra.run.smithi073.stdout:(91/121): python3-repoze-lru-0.7-6.el8.noarch.r 309 kB/s | 34 kB 00:00 2024-03-24T10:37:09.142 INFO:teuthology.orchestra.run.smithi073.stdout:(92/121): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2024-03-24T10:37:09.167 INFO:teuthology.orchestra.run.smithi073.stdout:(93/121): python3-rsa-4.9-2.el8.noarch.rpm 590 kB/s | 64 kB 00:00 2024-03-24T10:37:09.217 INFO:teuthology.orchestra.run.smithi073.stdout:(94/121): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2024-03-24T10:37:09.243 INFO:teuthology.orchestra.run.smithi073.stdout:(95/121): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-03-24T10:37:09.268 INFO:teuthology.orchestra.run.smithi073.stdout:(96/121): python3-tempora-1.14.1-5.el8.noarch.r 290 kB/s | 29 kB 00:00 2024-03-24T10:37:09.360 INFO:teuthology.orchestra.run.smithi073.stdout:(97/121): python3-trustme-0.6.0-4.el8.noarch.rp 193 kB/s | 27 kB 00:00 2024-03-24T10:37:09.410 INFO:teuthology.orchestra.run.smithi073.stdout:(98/121): python3-waitress-1.4.3-1.el8.noarch.r 1.5 MB/s | 255 kB 00:00 2024-03-24T10:37:09.435 INFO:teuthology.orchestra.run.smithi073.stdout:(99/121): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2024-03-24T10:37:09.503 INFO:teuthology.orchestra.run.smithi073.stdout:(100/121): python3-websocket-client-0.56.0-5.el 430 kB/s | 61 kB 00:00 2024-03-24T10:37:09.553 INFO:teuthology.orchestra.run.smithi073.stdout:(101/121): python3-webtest-2.0.33-1.el8.noarch. 601 kB/s | 85 kB 00:00 2024-03-24T10:37:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:(102/121): python3-zc-lockfile-2.0-2.el8.noarch 152 kB/s | 23 kB 00:00 2024-03-24T10:37:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:(103/121): librbd1-14.2.22-0.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi073.stdout:(104/121): librados2-14.2.22-0.el8.x86_64.rpm 16 MB/s | 3.5 MB 00:00 2024-03-24T10:37:09.779 INFO:teuthology.orchestra.run.smithi073.stdout:(105/121): NetworkManager-1.40.16-15.el8.x86_64 12 MB/s | 2.3 MB 00:00 2024-03-24T10:37:09.887 INFO:teuthology.orchestra.run.smithi073.stdout:(106/121): NetworkManager-tui-1.40.16-15.el8.x8 3.2 MB/s | 356 kB 00:00 2024-03-24T10:37:09.988 INFO:teuthology.orchestra.run.smithi073.stdout:(107/121): NetworkManager-libnm-1.40.16-15.el8. 5.4 MB/s | 1.9 MB 00:00 2024-03-24T10:37:10.013 INFO:teuthology.orchestra.run.smithi073.stdout:(108/121): elfutils-debuginfod-client-0.190-2.e 612 kB/s | 77 kB 00:00 2024-03-24T10:37:10.138 INFO:teuthology.orchestra.run.smithi073.stdout:(109/121): elfutils-libelf-0.190-2.el8.x86_64.r 1.5 MB/s | 233 kB 00:00 2024-03-24T10:37:10.289 INFO:teuthology.orchestra.run.smithi073.stdout:(110/121): iproute-6.2.0-5.el8.x86_64.rpm 5.6 MB/s | 854 kB 00:00 2024-03-24T10:37:10.314 INFO:teuthology.orchestra.run.smithi073.stdout:(111/121): NetworkManager-team-1.40.16-15.el8.x 275 kB/s | 161 kB 00:00 2024-03-24T10:37:10.339 INFO:teuthology.orchestra.run.smithi073.stdout:(112/121): elfutils-libs-0.190-2.el8.x86_64.rpm 937 kB/s | 305 kB 00:00 2024-03-24T10:37:10.398 INFO:teuthology.orchestra.run.smithi073.stdout:(113/121): libblkid-2.32.1-46.el8.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-03-24T10:37:10.465 INFO:teuthology.orchestra.run.smithi073.stdout:(114/121): libmount-2.32.1-46.el8.x86_64.rpm 1.8 MB/s | 237 kB 00:00 2024-03-24T10:37:10.507 INFO:teuthology.orchestra.run.smithi073.stdout:(115/121): libsmartcols-2.32.1-46.el8.x86_64.rp 1.6 MB/s | 180 kB 00:00 2024-03-24T10:37:10.523 INFO:teuthology.orchestra.run.smithi078.stdout:(37/121): python3-numpy-1.14.3-10.el8.x86_64.rp 1.9 MB/s | 3.7 MB 00:01 2024-03-24T10:37:10.540 INFO:teuthology.orchestra.run.smithi073.stdout:(116/121): libfdisk-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 254 kB 00:00 2024-03-24T10:37:10.574 INFO:teuthology.orchestra.run.smithi073.stdout:(117/121): libuuid-2.32.1-46.el8.x86_64.rpm 910 kB/s | 99 kB 00:00 2024-03-24T10:37:10.599 INFO:teuthology.orchestra.run.smithi078.stdout:(38/121): openblas-threads-0.3.15-4.el8.x86_64. 2.0 MB/s | 4.9 MB 00:02 2024-03-24T10:37:10.641 INFO:teuthology.orchestra.run.smithi073.stdout:(118/121): openssl-1.1.1k-12.el8.x86_64.rpm 5.4 MB/s | 738 kB 00:00 2024-03-24T10:37:10.741 INFO:teuthology.orchestra.run.smithi073.stdout:(119/121): util-linux-2.32.1-46.el8.x86_64.rpm 16 MB/s | 2.6 MB 00:00 2024-03-24T10:37:10.766 INFO:teuthology.orchestra.run.smithi073.stdout:(120/121): util-linux-user-2.32.1-46.el8.x86_64 824 kB/s | 103 kB 00:00 2024-03-24T10:37:10.774 INFO:teuthology.orchestra.run.smithi078.stdout:(39/121): openblas-0.3.15-4.el8.x86_64.rpm 1.8 MB/s | 4.7 MB 00:02 2024-03-24T10:37:10.799 INFO:teuthology.orchestra.run.smithi078.stdout:(40/121): python3-prettytable-0.7.2-14.el8.noar 219 kB/s | 44 kB 00:00 2024-03-24T10:37:10.825 INFO:teuthology.orchestra.run.smithi078.stdout:(41/121): python3-numpy-f2py-1.14.3-10.el8.x86_ 749 kB/s | 225 kB 00:00 2024-03-24T10:37:10.875 INFO:teuthology.orchestra.run.smithi078.stdout:(42/121): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2024-03-24T10:37:10.875 INFO:teuthology.orchestra.run.smithi073.stdout:(121/121): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.4 MB/s | 1.5 MB 00:00 2024-03-24T10:37:10.878 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:37:10.878 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 166 MB 00:11 2024-03-24T10:37:10.908 INFO:teuthology.orchestra.run.smithi078.stdout:(43/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-03-24T10:37:10.934 INFO:teuthology.orchestra.run.smithi078.stdout:(44/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2024-03-24T10:37:10.968 INFO:teuthology.orchestra.run.smithi078.stdout:(45/121): python3-pytz-2017.2-11.el8.noarch.rpm 616 kB/s | 57 kB 00:00 2024-03-24T10:37:11.143 INFO:teuthology.orchestra.run.smithi078.stdout:(46/121): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2024-03-24T10:37:11.243 INFO:teuthology.orchestra.run.smithi078.stdout:(47/121): xmlstarlet-1.6.1-20.el8.x86_64.rpm 707 kB/s | 71 kB 00:00 2024-03-24T10:37:11.268 INFO:teuthology.orchestra.run.smithi078.stdout:(48/121): python3-werkzeug-0.12.2-4.el8.noarch. 1.3 MB/s | 457 kB 00:00 2024-03-24T10:37:11.619 INFO:teuthology.orchestra.run.smithi078.stdout:(49/121): elfutils-libelf-devel-0.190-2.el8.x86 166 kB/s | 62 kB 00:00 2024-03-24T10:37:11.655 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-24T10:37:11.677 INFO:teuthology.orchestra.run.smithi078.stdout:(50/121): fuse-2.9.7-19.el8.x86_64.rpm 204 kB/s | 83 kB 00:00 2024-03-24T10:37:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:(51/121): keyutils-libs-devel-1.5.10-9.el8.x86_ 338 kB/s | 48 kB 00:00 2024-03-24T10:37:11.895 INFO:teuthology.orchestra.run.smithi078.stdout:(52/121): libcom_err-devel-1.45.6-5.el8.x86_64. 291 kB/s | 39 kB 00:00 2024-03-24T10:37:11.914 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-24T10:37:11.914 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-24T10:37:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:(53/121): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2024-03-24T10:37:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:(54/121): libquadmath-8.5.0-21.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-03-24T10:37:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:(55/121): librabbitmq-0.9.0-5.el8.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-03-24T10:37:12.279 INFO:teuthology.orchestra.run.smithi078.stdout:(56/121): libgfortran-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 645 kB 00:00 2024-03-24T10:37:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:(57/121): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2024-03-24T10:37:12.388 INFO:teuthology.orchestra.run.smithi078.stdout:(58/121): libsepol-devel-2.9-3.el8.x86_64.rpm 800 kB/s | 87 kB 00:00 2024-03-24T10:37:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:(59/121): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2024-03-24T10:37:12.488 INFO:teuthology.orchestra.run.smithi078.stdout:(60/121): libzstd-devel-1.4.4-1.el8.x86_64.rpm 437 kB/s | 44 kB 00:00 2024-03-24T10:37:12.647 INFO:teuthology.orchestra.run.smithi078.stdout:(61/121): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2024-03-24T10:37:12.764 INFO:teuthology.orchestra.run.smithi078.stdout:(62/121): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-03-24T10:37:12.822 INFO:teuthology.orchestra.run.smithi078.stdout:(63/121): openssl-devel-1.1.1k-12.el8.x86_64.rp 8.9 MB/s | 3.2 MB 00:00 2024-03-24T10:37:12.861 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-24T10:37:12.864 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-24T10:37:12.881 INFO:teuthology.orchestra.run.smithi078.stdout:(64/121): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2024-03-24T10:37:12.923 INFO:teuthology.orchestra.run.smithi078.stdout:(65/121): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2024-03-24T10:37:13.023 INFO:teuthology.orchestra.run.smithi078.stdout:(66/121): python3-jwt-1.6.1-2.el8.noarch.rpm 425 kB/s | 43 kB 00:00 2024-03-24T10:37:13.049 INFO:teuthology.orchestra.run.smithi078.stdout:(67/121): python3-cryptography-3.2.1-7.el8.x86_ 3.7 MB/s | 641 kB 00:00 2024-03-24T10:37:13.141 INFO:teuthology.orchestra.run.smithi078.stdout:(68/121): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2024-03-24T10:37:13.191 INFO:teuthology.orchestra.run.smithi078.stdout:(69/121): python3-pycparser-2.14-14.el8.noarch. 770 kB/s | 109 kB 00:00 2024-03-24T10:37:13.241 INFO:teuthology.orchestra.run.smithi078.stdout:(70/121): python3-requests-oauthlib-1.0.0-1.el8 430 kB/s | 43 kB 00:00 2024-03-24T10:37:13.291 INFO:teuthology.orchestra.run.smithi078.stdout:(71/121): zlib-devel-1.2.11-21.el8.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-03-24T10:37:13.758 INFO:teuthology.orchestra.run.smithi078.stdout:(72/121): leveldb-1.22-1.el8.x86_64.rpm 388 kB/s | 181 kB 00:00 2024-03-24T10:37:13.784 INFO:teuthology.orchestra.run.smithi078.stdout:(73/121): gperftools-libs-2.7-9.el8.x86_64.rpm 564 kB/s | 306 kB 00:00 2024-03-24T10:37:13.876 INFO:teuthology.orchestra.run.smithi078.stdout:(74/121): liboath-2.6.2-3.el8.x86_64.rpm 502 kB/s | 59 kB 00:00 2024-03-24T10:37:13.901 INFO:teuthology.orchestra.run.smithi078.stdout:(75/121): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2024-03-24T10:37:13.985 INFO:teuthology.orchestra.run.smithi078.stdout:(76/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2024-03-24T10:37:14.018 INFO:teuthology.orchestra.run.smithi078.stdout:(77/121): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2024-03-24T10:37:14.085 INFO:teuthology.orchestra.run.smithi078.stdout:(78/121): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2024-03-24T10:37:14.110 INFO:teuthology.orchestra.run.smithi078.stdout:(79/121): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2024-03-24T10:37:14.244 INFO:teuthology.orchestra.run.smithi078.stdout:(80/121): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2024-03-24T10:37:14.278 INFO:teuthology.orchestra.run.smithi078.stdout:(81/121): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2024-03-24T10:37:14.378 INFO:teuthology.orchestra.run.smithi078.stdout:(82/121): python3-google-auth-1.1.1-10.el8.noar 608 kB/s | 81 kB 00:00 2024-03-24T10:37:14.395 INFO:teuthology.orchestra.run.smithi078.stdout:(83/121): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-03-24T10:37:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:(84/121): python3-jaraco-functools-2.0-4.el8.no 211 kB/s | 18 kB 00:00 2024-03-24T10:37:14.546 INFO:teuthology.orchestra.run.smithi078.stdout:(85/121): python3-logutils-0.3.5-11.el8.noarch. 584 kB/s | 49 kB 00:00 2024-03-24T10:37:14.630 INFO:teuthology.orchestra.run.smithi078.stdout:(86/121): python3-more-itertools-7.2.0-3.el8.no 704 kB/s | 59 kB 00:00 2024-03-24T10:37:14.796 INFO:teuthology.orchestra.run.smithi078.stdout:(87/121): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-03-24T10:37:14.888 INFO:teuthology.orchestra.run.smithi078.stdout:(88/121): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2024-03-24T10:37:14.930 INFO:teuthology.orchestra.run.smithi078.stdout:(89/121): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2024-03-24T10:37:14.980 INFO:teuthology.orchestra.run.smithi078.stdout:(90/121): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2024-03-24T10:37:15.031 INFO:teuthology.orchestra.run.smithi078.stdout:(91/121): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2024-03-24T10:37:15.073 INFO:teuthology.orchestra.run.smithi078.stdout:(92/121): python3-rsa-4.9-2.el8.noarch.rpm 699 kB/s | 64 kB 00:00 2024-03-24T10:37:15.126 INFO:teuthology.orchestra.run.smithi078.stdout:(93/121): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2024-03-24T10:37:15.165 INFO:teuthology.orchestra.run.smithi078.stdout:(94/121): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2024-03-24T10:37:15.215 INFO:teuthology.orchestra.run.smithi078.stdout:(95/121): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2024-03-24T10:37:15.257 INFO:teuthology.orchestra.run.smithi078.stdout:(96/121): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2024-03-24T10:37:15.349 INFO:teuthology.orchestra.run.smithi078.stdout:(97/121): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2024-03-24T10:37:15.383 INFO:teuthology.orchestra.run.smithi078.stdout:(98/121): python3-waitress-1.4.3-1.el8.noarch.r 1.5 MB/s | 255 kB 00:00 2024-03-24T10:37:15.441 INFO:teuthology.orchestra.run.smithi078.stdout:(99/121): python3-websocket-client-0.56.0-5.el8 667 kB/s | 61 kB 00:00 2024-03-24T10:37:15.467 INFO:teuthology.orchestra.run.smithi078.stdout:(100/121): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2024-03-24T10:37:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:(101/121): librados2-14.2.22-0.el8.x86_64.rpm 31 MB/s | 3.5 MB 00:00 2024-03-24T10:37:15.609 INFO:teuthology.orchestra.run.smithi078.stdout:(102/121): python3-zc-lockfile-2.0-2.el8.noarch 137 kB/s | 23 kB 00:00 2024-03-24T10:37:15.659 INFO:teuthology.orchestra.run.smithi078.stdout:(103/121): librbd1-14.2.22-0.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-03-24T10:37:15.801 INFO:teuthology.orchestra.run.smithi078.stdout:(104/121): NetworkManager-libnm-1.40.16-15.el8. 13 MB/s | 1.9 MB 00:00 2024-03-24T10:37:15.885 INFO:teuthology.orchestra.run.smithi078.stdout:(105/121): NetworkManager-1.40.16-15.el8.x86_64 8.3 MB/s | 2.3 MB 00:00 2024-03-24T10:37:15.910 INFO:teuthology.orchestra.run.smithi078.stdout:(106/121): NetworkManager-team-1.40.16-15.el8.x 1.4 MB/s | 161 kB 00:00 2024-03-24T10:37:16.102 INFO:teuthology.orchestra.run.smithi078.stdout:(107/121): python3-scipy-1.0.0-21.module_el8+76 2.7 MB/s | 14 MB 00:05 2024-03-24T10:37:16.128 INFO:teuthology.orchestra.run.smithi078.stdout:(108/121): elfutils-debuginfod-client-0.190-2.e 354 kB/s | 77 kB 00:00 2024-03-24T10:37:16.153 INFO:teuthology.orchestra.run.smithi078.stdout:(109/121): NetworkManager-tui-1.40.16-15.el8.x8 1.3 MB/s | 356 kB 00:00 2024-03-24T10:37:16.228 INFO:teuthology.orchestra.run.smithi078.stdout:(110/121): elfutils-libs-0.190-2.el8.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-03-24T10:37:16.279 INFO:teuthology.orchestra.run.smithi078.stdout:(111/121): iproute-6.2.0-5.el8.x86_64.rpm 6.7 MB/s | 854 kB 00:00 2024-03-24T10:37:16.329 INFO:teuthology.orchestra.run.smithi078.stdout:(112/121): libblkid-2.32.1-46.el8.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-03-24T10:37:16.387 INFO:teuthology.orchestra.run.smithi078.stdout:(113/121): libfdisk-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2024-03-24T10:37:16.429 INFO:teuthology.orchestra.run.smithi078.stdout:(114/121): libmount-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2024-03-24T10:37:16.488 INFO:teuthology.orchestra.run.smithi078.stdout:(115/121): libsmartcols-2.32.1-46.el8.x86_64.rp 1.8 MB/s | 180 kB 00:00 2024-03-24T10:37:16.530 INFO:teuthology.orchestra.run.smithi078.stdout:(116/121): libuuid-2.32.1-46.el8.x86_64.rpm 994 kB/s | 99 kB 00:00 2024-03-24T10:37:16.605 INFO:teuthology.orchestra.run.smithi078.stdout:(117/121): openssl-1.1.1k-12.el8.x86_64.rpm 6.2 MB/s | 738 kB 00:00 2024-03-24T10:37:16.663 INFO:teuthology.orchestra.run.smithi078.stdout:(118/121): openssl-libs-1.1.1k-12.el8.x86_64.rp 11 MB/s | 1.5 MB 00:00 2024-03-24T10:37:16.680 INFO:teuthology.orchestra.run.smithi078.stdout:(119/121): elfutils-libelf-0.190-2.el8.x86_64.r 403 kB/s | 233 kB 00:00 2024-03-24T10:37:16.814 INFO:teuthology.orchestra.run.smithi078.stdout:(120/121): util-linux-2.32.1-46.el8.x86_64.rpm 12 MB/s | 2.6 MB 00:00 2024-03-24T10:37:16.844 INFO:teuthology.orchestra.run.smithi078.stdout:(121/121): util-linux-user-2.32.1-46.el8.x86_64 587 kB/s | 103 kB 00:00 2024-03-24T10:37:16.845 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:37:16.845 INFO:teuthology.orchestra.run.smithi078.stdout:Total 13 MB/s | 166 MB 00:12 2024-03-24T10:37:17.883 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-24T10:37:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-03-24T10:37:18.251 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-03-24T10:37:18.297 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-03-24T10:37:18.317 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-03-24T10:37:18.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/140 2024-03-24T10:37:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-03-24T10:37:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-03-24T10:37:18.722 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/140 2024-03-24T10:37:18.905 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 4/140 2024-03-24T10:37:19.054 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 5/140 2024-03-24T10:37:19.127 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 5/140 2024-03-24T10:37:19.351 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 6/140 2024-03-24T10:37:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 6/140 2024-03-24T10:37:19.702 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 7/140 2024-03-24T10:37:19.876 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-03-24T10:37:19.880 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-03-24T10:37:19.883 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-03-24T10:37:20.276 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-03-24T10:37:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:37:20.676 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:37:20.884 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:37:20.989 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:37:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:37:21.277 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:37:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 12/140 2024-03-24T10:37:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:37:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:37:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2024-03-24T10:37:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2024-03-24T10:37:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:37:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:37:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-03-24T10:37:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-03-24T10:37:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:24.017 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:24.405 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:24.438 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-03-24T10:37:24.606 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/140 2024-03-24T10:37:24.622 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-03-24T10:37:24.805 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/140 2024-03-24T10:37:24.829 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-03-24T10:37:24.909 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-03-24T10:37:24.942 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/140 2024-03-24T10:37:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/140 2024-03-24T10:37:25.073 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/140 2024-03-24T10:37:25.217 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/140 2024-03-24T10:37:25.309 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/140 2024-03-24T10:37:25.471 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 4/140 2024-03-24T10:37:25.604 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 5/140 2024-03-24T10:37:25.704 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 5/140 2024-03-24T10:37:25.819 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/140 2024-03-24T10:37:25.862 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 6/140 2024-03-24T10:37:25.984 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 6/140 2024-03-24T10:37:26.008 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/140 2024-03-24T10:37:26.255 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 7/140 2024-03-24T10:37:26.421 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-03-24T10:37:26.614 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/140 2024-03-24T10:37:26.775 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-03-24T10:37:26.853 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-03-24T10:37:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:37:27.321 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:37:27.477 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-03-24T10:37:27.520 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:37:27.640 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:37:27.854 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:37:27.943 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/140 2024-03-24T10:37:27.961 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:37:28.188 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/140 2024-03-24T10:37:28.308 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 27/140 2024-03-24T10:37:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 28/140 2024-03-24T10:37:28.620 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 12/140 2024-03-24T10:37:28.778 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:37:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-03-24T10:37:28.996 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:37:29.201 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2024-03-24T10:37:29.405 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2024-03-24T10:37:29.553 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:37:29.912 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:37:30.195 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-03-24T10:37:30.272 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-03-24T10:37:30.548 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:30.563 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-03-24T10:37:30.771 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/140 2024-03-24T10:37:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/140 2024-03-24T10:37:31.219 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-03-24T10:37:31.270 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/140 2024-03-24T10:37:31.454 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/140 2024-03-24T10:37:31.501 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 33/140 2024-03-24T10:37:31.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/140 2024-03-24T10:37:31.725 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 34/140 2024-03-24T10:37:31.745 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/140 2024-03-24T10:37:31.885 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/140 2024-03-24T10:37:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 35/140 2024-03-24T10:37:32.045 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/140 2024-03-24T10:37:32.113 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 36/140 2024-03-24T10:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 37/140 2024-03-24T10:37:32.558 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 38/140 2024-03-24T10:37:32.617 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 38/140 2024-03-24T10:37:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/140 2024-03-24T10:37:32.816 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 39/140 2024-03-24T10:37:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/140 2024-03-24T10:37:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 39/140 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 40/140 2024-03-24T10:37:33.351 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/140 2024-03-24T10:37:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/140 2024-03-24T10:37:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-03-24T10:37:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-03-24T10:37:34.224 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 43/140 2024-03-24T10:37:34.239 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 43/140 2024-03-24T10:37:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 44/140 2024-03-24T10:37:34.504 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-03-24T10:37:34.699 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 45/140 2024-03-24T10:37:34.875 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/140 2024-03-24T10:37:34.905 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 46/140 2024-03-24T10:37:35.103 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 47/140 2024-03-24T10:37:35.116 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/140 2024-03-24T10:37:35.250 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 48/140 2024-03-24T10:37:35.271 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 27/140 2024-03-24T10:37:35.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 49/140 2024-03-24T10:37:35.527 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 28/140 2024-03-24T10:37:35.691 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 50/140 2024-03-24T10:37:35.736 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-03-24T10:37:35.876 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 51/140 2024-03-24T10:37:36.021 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 52/140 2024-03-24T10:37:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 53/140 2024-03-24T10:37:36.365 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/140 2024-03-24T10:37:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/140 2024-03-24T10:37:36.839 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/140 2024-03-24T10:37:37.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/140 2024-03-24T10:37:37.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/140 2024-03-24T10:37:37.458 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 59/140 2024-03-24T10:37:37.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 60/140 2024-03-24T10:37:37.754 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-03-24T10:37:37.929 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/140 2024-03-24T10:37:38.063 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/140 2024-03-24T10:37:38.275 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/140 2024-03-24T10:37:38.297 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 62/140 2024-03-24T10:37:38.457 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/140 2024-03-24T10:37:38.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 63/140 2024-03-24T10:37:38.699 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 33/140 2024-03-24T10:37:38.750 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 64/140 2024-03-24T10:37:38.897 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 34/140 2024-03-24T10:37:38.976 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 65/140 2024-03-24T10:37:39.103 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 35/140 2024-03-24T10:37:39.194 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 66/140 2024-03-24T10:37:39.325 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 36/140 2024-03-24T10:37:39.529 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 37/140 2024-03-24T10:37:39.744 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 38/140 2024-03-24T10:37:39.840 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 38/140 2024-03-24T10:37:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 39/140 2024-03-24T10:37:40.201 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 39/140 2024-03-24T10:37:40.204 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 67/140 2024-03-24T10:37:40.410 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 40/140 2024-03-24T10:37:40.439 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 68/140 2024-03-24T10:37:40.598 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/140 2024-03-24T10:37:40.660 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 69/140 2024-03-24T10:37:40.769 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-03-24T10:37:40.832 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 70/140 2024-03-24T10:37:41.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/140 2024-03-24T10:37:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 72/140 2024-03-24T10:37:41.306 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-03-24T10:37:41.561 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 43/140 2024-03-24T10:37:41.569 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 73/140 2024-03-24T10:37:41.587 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 43/140 2024-03-24T10:37:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 74/140 2024-03-24T10:37:41.758 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 44/140 2024-03-24T10:37:41.883 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 75/140 2024-03-24T10:37:42.007 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 45/140 2024-03-24T10:37:42.102 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 76/140 2024-03-24T10:37:42.234 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 46/140 2024-03-24T10:37:42.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 77/140 2024-03-24T10:37:42.407 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 47/140 2024-03-24T10:37:42.574 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 48/140 2024-03-24T10:37:42.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 78/140 2024-03-24T10:37:42.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 79/140 2024-03-24T10:37:42.756 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 49/140 2024-03-24T10:37:42.966 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 50/140 2024-03-24T10:37:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/140 2024-03-24T10:37:43.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 51/140 2024-03-24T10:37:43.198 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 81/140 2024-03-24T10:37:43.300 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 52/140 2024-03-24T10:37:43.432 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-19.el8.x86_64 82/140 2024-03-24T10:37:43.461 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 53/140 2024-03-24T10:37:43.638 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 83/140 2024-03-24T10:37:43.654 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/140 2024-03-24T10:37:43.810 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 84/140 2024-03-24T10:37:43.876 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/140 2024-03-24T10:37:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/140 2024-03-24T10:37:44.148 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/140 2024-03-24T10:37:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/140 2024-03-24T10:37:44.374 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/140 2024-03-24T10:37:44.554 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/140 2024-03-24T10:37:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/140 2024-03-24T10:37:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/140 2024-03-24T10:37:44.813 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 59/140 2024-03-24T10:37:45.022 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 60/140 2024-03-24T10:37:45.255 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/140 2024-03-24T10:37:45.671 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 62/140 2024-03-24T10:37:45.916 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 63/140 2024-03-24T10:37:46.115 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 64/140 2024-03-24T10:37:46.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 65/140 2024-03-24T10:37:46.552 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 66/140 2024-03-24T10:37:46.841 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:47.718 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:47.777 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 67/140 2024-03-24T10:37:48.027 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 68/140 2024-03-24T10:37:48.038 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-03-24T10:37:48.135 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-03-24T10:37:48.251 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 69/140 2024-03-24T10:37:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-03-24T10:37:48.445 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 70/140 2024-03-24T10:37:48.688 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/140 2024-03-24T10:37:48.881 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 72/140 2024-03-24T10:37:49.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 73/140 2024-03-24T10:37:49.449 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 74/140 2024-03-24T10:37:49.628 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 75/140 2024-03-24T10:37:49.858 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 76/140 2024-03-24T10:37:50.183 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 77/140 2024-03-24T10:37:50.397 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 78/140 2024-03-24T10:37:50.565 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 79/140 2024-03-24T10:37:50.755 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/140 2024-03-24T10:37:50.946 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 81/140 2024-03-24T10:37:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-19.el8.x86_64 82/140 2024-03-24T10:37:51.350 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 83/140 2024-03-24T10:37:51.513 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 84/140 2024-03-24T10:37:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/140 2024-03-24T10:37:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/140 2024-03-24T10:37:52.277 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/140 2024-03-24T10:37:52.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/140 2024-03-24T10:37:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:55.151 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:55.858 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-03-24T10:37:56.167 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-03-24T10:37:56.340 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-03-24T10:37:56.484 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-03-24T10:38:07.815 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2024-03-24T10:38:07.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:08.219 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-03-24T10:38:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-03-24T10:38:08.777 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-03-24T10:38:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-03-24T10:38:10.360 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-03-24T10:38:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-03-24T10:38:10.612 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 95/140 2024-03-24T10:38:10.962 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 96/140 2024-03-24T10:38:11.254 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/140 2024-03-24T10:38:11.393 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 98/140 2024-03-24T10:38:11.471 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 98/140 2024-03-24T10:38:11.700 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-8.el8.x86_64 99/140 2024-03-24T10:38:12.626 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 100/140 2024-03-24T10:38:12.884 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-03-24T10:38:13.200 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-03-24T10:38:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-03-24T10:38:13.423 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-03-24T10:38:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-03-24T10:38:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-03-24T10:38:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-03-24T10:38:14.060 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-03-24T10:38:17.163 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-03-24T10:38:17.164 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-03-24T10:38:17.164 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2024-03-24T10:38:17.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:17.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 105/140 2024-03-24T10:38:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-03-24T10:38:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 106/140 2024-03-24T10:38:17.957 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-03-24T10:38:18.148 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-03-24T10:38:18.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-03-24T10:38:18.420 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-03-24T10:38:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-03-24T10:38:18.677 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-03-24T10:38:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 109/140 2024-03-24T10:38:19.617 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-03-24T10:38:19.856 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-03-24T10:38:19.863 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 110/140 2024-03-24T10:38:19.921 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-03-24T10:38:20.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 111/140 2024-03-24T10:38:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 95/140 2024-03-24T10:38:20.228 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 112/140 2024-03-24T10:38:20.404 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 113/140 2024-03-24T10:38:20.531 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 96/140 2024-03-24T10:38:20.605 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 114/140 2024-03-24T10:38:20.749 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 115/140 2024-03-24T10:38:20.835 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/140 2024-03-24T10:38:20.963 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 116/140 2024-03-24T10:38:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 98/140 2024-03-24T10:38:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 98/140 2024-03-24T10:38:21.250 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 117/140 2024-03-24T10:38:21.322 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-8.el8.x86_64 99/140 2024-03-24T10:38:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 118/140 2024-03-24T10:38:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 119/140 2024-03-24T10:38:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/140 2024-03-24T10:38:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/140 2024-03-24T10:38:22.350 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 100/140 2024-03-24T10:38:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/140 2024-03-24T10:38:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/140 2024-03-24T10:38:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 122/140 2024-03-24T10:38:22.621 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-03-24T10:38:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/140 2024-03-24T10:38:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/140 2024-03-24T10:38:22.991 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-03-24T10:38:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 125/140 2024-03-24T10:38:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-03-24T10:38:23.171 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-03-24T10:38:23.201 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-03-24T10:38:23.380 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-03-24T10:38:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-03-24T10:38:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/140 2024-03-24T10:38:23.603 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-03-24T10:38:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/140 2024-03-24T10:38:23.793 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/140 2024-03-24T10:38:23.847 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-03-24T10:38:23.887 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-03-24T10:38:23.960 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/140 2024-03-24T10:38:24.185 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/140 2024-03-24T10:38:24.185 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/140 2024-03-24T10:38:24.427 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/140 2024-03-24T10:38:24.427 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:24.660 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/140 2024-03-24T10:38:24.868 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/140 2024-03-24T10:38:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 134/140 2024-03-24T10:38:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:25.511 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:25.511 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-03-24T10:38:25.751 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-03-24T10:38:25.752 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 137/140 2024-03-24T10:38:25.935 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 137/140 2024-03-24T10:38:25.935 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:26.310 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 139/140 2024-03-24T10:38:26.310 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 2/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 3/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 4/140 2024-03-24T10:38:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 5/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 6/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 7/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 8/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 12/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 14/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 15/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:38:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 17/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 18/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 19/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 20/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 21/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 22/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 23/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 24/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 25/140 2024-03-24T10:38:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 26/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 27/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 28/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.0.4-10.el8.x86_64 29/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.1-9.el8.x86_64 30/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-8.el8.x86_64 31/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 32/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 33/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 34/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 35/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 36/140 2024-03-24T10:38:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 37/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 38/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 39/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 41/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 42/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 43/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 45/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 46/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 47/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 48/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 49/140 2024-03-24T10:38:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 50/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 51/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 53/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 54/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 55/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 56/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 57/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 58/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 59/140 2024-03-24T10:38:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 60/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 61/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 62/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 63/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 64/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 65/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 66/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 67/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 68/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 69/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 70/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/140 2024-03-24T10:38:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 72/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : leveldb-1.22-1.el8.x86_64 74/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 75/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 76/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/140 2024-03-24T10:38:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 89/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 90/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 91/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 92/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 93/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 94/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 95/140 2024-03-24T10:38:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 96/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 97/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 98/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 99/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 100/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 101/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 102/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 103/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 104/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 105/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 106/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 107/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 108/140 2024-03-24T10:38:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 109/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 110/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 111/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 112/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 113/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 114/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 115/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 117/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 119/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/140 2024-03-24T10:38:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 123/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 125/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 127/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 129/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 131/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 133/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 134/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 135/140 2024-03-24T10:38:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 136/140 2024-03-24T10:38:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 137/140 2024-03-24T10:38:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 139/140 2024-03-24T10:38:27.218 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 105/140 2024-03-24T10:38:27.984 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 106/140 2024-03-24T10:38:28.246 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-03-24T10:38:28.500 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-03-24T10:38:28.697 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-03-24T10:38:28.790 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-03-24T10:38:28.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 140/140 2024-03-24T10:38:28.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:28.867 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-6.2.0-5.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.868 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.0.4-10.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.869 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.1-9.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.7-19.el8.x86_64 2024-03-24T10:38:28.870 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-8.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: leveldb-1.22-1.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-24T10:38:28.871 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-4.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-24T10:38:28.872 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-03-24T10:38:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-24T10:38:28.874 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-24T10:38:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-03-24T10:38:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-03-24T10:38:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:28.877 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-24T10:38:29.094 DEBUG:teuthology.parallel:result is None 2024-03-24T10:38:29.945 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 109/140 2024-03-24T10:38:30.209 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 110/140 2024-03-24T10:38:30.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 111/140 2024-03-24T10:38:30.623 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 112/140 2024-03-24T10:38:30.808 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 113/140 2024-03-24T10:38:31.013 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 114/140 2024-03-24T10:38:31.220 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 115/140 2024-03-24T10:38:31.434 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 116/140 2024-03-24T10:38:31.783 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 117/140 2024-03-24T10:38:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 118/140 2024-03-24T10:38:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 119/140 2024-03-24T10:38:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/140 2024-03-24T10:38:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/140 2024-03-24T10:38:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/140 2024-03-24T10:38:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/140 2024-03-24T10:38:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 122/140 2024-03-24T10:38:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/140 2024-03-24T10:38:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/140 2024-03-24T10:38:33.813 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 125/140 2024-03-24T10:38:33.813 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-03-24T10:38:34.065 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-03-24T10:38:34.065 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/140 2024-03-24T10:38:34.319 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/140 2024-03-24T10:38:34.505 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/140 2024-03-24T10:38:34.675 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/140 2024-03-24T10:38:34.880 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/140 2024-03-24T10:38:34.880 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/140 2024-03-24T10:38:35.090 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/140 2024-03-24T10:38:35.090 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:35.315 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:35.315 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/140 2024-03-24T10:38:35.573 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/140 2024-03-24T10:38:35.731 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 134/140 2024-03-24T10:38:35.751 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:35.752 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:36.266 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-03-24T10:38:36.266 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-03-24T10:38:36.523 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-03-24T10:38:36.523 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 137/140 2024-03-24T10:38:36.789 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 137/140 2024-03-24T10:38:36.790 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:36.998 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:37.197 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 139/140 2024-03-24T10:38:37.197 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-03-24T10:38:37.687 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-03-24T10:38:37.687 INFO:teuthology.orchestra.run.smithi078.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-24T10:38:37.687 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/140 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 2/140 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 3/140 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 4/140 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 5/140 2024-03-24T10:38:38.361 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 6/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 7/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 8/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 9/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 10/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 11/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 12/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 13/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 14/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 15/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 16/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 17/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 18/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 19/140 2024-03-24T10:38:38.362 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 20/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 21/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 22/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 23/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 24/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 25/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 26/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 27/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 28/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 29/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 30/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-8.el8.x86_64 31/140 2024-03-24T10:38:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 32/140 2024-03-24T10:38:38.373 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 33/140 2024-03-24T10:38:38.373 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 34/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 35/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 36/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 37/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 38/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 39/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 41/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 42/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 43/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 45/140 2024-03-24T10:38:38.374 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 46/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 47/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 48/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 49/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 50/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 51/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 53/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 54/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 55/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 56/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 57/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 58/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 59/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 60/140 2024-03-24T10:38:38.375 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 61/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 62/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 63/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 64/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 65/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 66/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 67/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 68/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 69/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 70/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 72/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/140 2024-03-24T10:38:38.376 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : leveldb-1.22-1.el8.x86_64 74/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 75/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 76/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/140 2024-03-24T10:38:38.377 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 89/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 90/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 91/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 92/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 93/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 94/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 95/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 96/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 97/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 98/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 99/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 100/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 101/140 2024-03-24T10:38:38.378 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 102/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 103/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 104/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 105/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 106/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 107/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 108/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 109/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 110/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 111/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 112/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 113/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 114/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 115/140 2024-03-24T10:38:38.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 117/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 119/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 123/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 125/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 127/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 129/140 2024-03-24T10:38:38.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 131/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 133/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 134/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 135/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 136/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 137/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 138/140 2024-03-24T10:38:38.381 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 139/140 2024-03-24T10:38:40.051 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 140/140 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-03-24T10:38:40.052 INFO:teuthology.orchestra.run.smithi078.stdout: iproute-6.2.0-5.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: libblkid-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: libmount-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-03-24T10:38:40.053 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-03-24T10:38:40.054 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-19.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-24T10:38:40.055 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-8.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb-1.22-1.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-24T10:38:40.056 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.15-4.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-03-24T10:38:40.057 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-24T10:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-24T10:38:40.059 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-03-24T10:38:40.060 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-24T10:38:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-1.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:40.062 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-03-24T10:38:40.337 DEBUG:teuthology.parallel:result is None 2024-03-24T10:38:40.338 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:38:40.338 INFO:teuthology.packaging:ref: None 2024-03-24T10:38:40.338 INFO:teuthology.packaging:tag: None 2024-03-24T10:38:40.338 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:38:40.338 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:38:40.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-03-24T10:38:40.511 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-24T10:38:40.540 INFO:teuthology.orchestra.run.smithi073.stdout:14.2.22-0.el8 2024-03-24T10:38:40.541 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-03-24T10:38:40.541 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-03-24T10:38:40.543 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:38:40.543 INFO:teuthology.packaging:ref: None 2024-03-24T10:38:40.543 INFO:teuthology.packaging:tag: None 2024-03-24T10:38:40.543 INFO:teuthology.packaging:branch: nautilus 2024-03-24T10:38:40.543 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:38:40.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-03-24T10:38:40.786 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-24T10:38:40.841 INFO:teuthology.orchestra.run.smithi078.stdout:14.2.22-0.el8 2024-03-24T10:38:40.841 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-03-24T10:38:40.842 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-03-24T10:38:40.843 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-24T10:38:40.844 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:40.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-24T10:38:40.880 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:40.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-24T10:38:40.955 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-24T10:38:40.955 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:40.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-03-24T10:38:40.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-24T10:38:41.059 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:41.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-03-24T10:38:41.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-24T10:38:41.236 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-24T10:38:41.236 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:41.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-24T10:38:41.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-24T10:38:41.338 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:41.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-24T10:38:41.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-24T10:38:41.514 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-24T10:38:41.514 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:41.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-03-24T10:38:41.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-24T10:38:41.616 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:41.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-03-24T10:38:41.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-24T10:38:41.798 INFO:teuthology.run_tasks:Running task print... 2024-03-24T10:38:41.807 INFO:teuthology.task.print:**** done installing nautilus 2024-03-24T10:38:41.807 INFO:teuthology.run_tasks:Running task ceph... 2024-03-24T10:38:41.901 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-24T10:38:41.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-03-24T10:38:41.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-03-24T10:38:41.972 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-24T10:38:41.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-24T10:38:41.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-24T10:38:42.040 INFO:tasks.ceph:Creating extra log directories... 2024-03-24T10:38:42.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-24T10:38:42.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-24T10:38:42.123 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-24T10:38:42.123 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-24T10:38:42.123 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066', 'branch': 'wip-batrick-testing-20240323.003144-squid', 'description': 'fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7619066', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240323.003144-squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240323.003144-squid', 'sha1': 'd39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 4284, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'sleep_before_teardown': 0, 'subset': '405/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240323.003144-squid', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': 'd39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqk9dATlwXy+rpqjN9Zyphqkl/rDchGeil0qHop71DGM9B989yvP/j18Vi+8MqKL+Rop/wRYfvol2AzB2Tg1k=', 'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWTV2diAXT+1yBgPlwwayXBRwwHcaQB0sLIXPCoYIUakDfA6u5A1a9ASmgoVG0TpRRKyUf9YeXhqnFR1Q1zqCM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}}, {'print': '**** done installing nautilus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client nautilus']}}, {'print': '**** done ceph'}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_newops']}}], 'teuthology': {'branch': 'nautilus', 'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', "if not is_kupstream() or syntax_version() == 'v2' then reject() end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-24_04:56:01', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-24T10:38:42.124 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-24T10:38:42.126 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-24T10:38:42.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-03-24T10:38:42.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-03-24T10:38:42.279 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:42.280 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-03-24T10:38:42.298 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-24T10:38:42.299 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-03-24T10:38:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-24T10:38:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:38:42.357 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 172317 Links: 1 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-24 10:38:26.766568563 +0000 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-24 10:35:03.636212628 +0000 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-24 10:35:03.636212628 +0000 2024-03-24T10:38:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-03-24T10:38:42.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-24T10:38:42.424 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-24T10:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-24T10:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.0003284 s, 1.6 MB/s 2024-03-24T10:38:42.426 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-24T10:38:42.485 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 176251 Links: 1 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-24 10:38:26.766568563 +0000 2024-03-24T10:38:42.543 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-24 10:35:03.983204183 +0000 2024-03-24T10:38:42.544 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-24 10:35:03.983204183 +0000 2024-03-24T10:38:42.544 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-03-24T10:38:42.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-24T10:38:42.608 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-24T10:38:42.608 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-24T10:38:42.608 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000240213 s, 2.1 MB/s 2024-03-24T10:38:42.609 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-24T10:38:42.668 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 176320 Links: 1 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-24 10:38:26.766568563 +0000 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-24 10:35:04.330195737 +0000 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-24 10:35:04.330195737 +0000 2024-03-24T10:38:42.727 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-03-24T10:38:42.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-24T10:38:42.792 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-24T10:38:42.792 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-24T10:38:42.792 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000184537 s, 2.8 MB/s 2024-03-24T10:38:42.793 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-24T10:38:42.854 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 175215 Links: 1 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-24 10:38:26.766568563 +0000 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-24 10:35:04.697186805 +0000 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-24 10:35:04.697186805 +0000 2024-03-24T10:38:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-03-24T10:38:42.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-24T10:38:42.978 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-24T10:38:42.978 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-24T10:38:42.978 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000228752 s, 2.2 MB/s 2024-03-24T10:38:42.979 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-24T10:38:43.039 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:38:43.039 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-03-24T10:38:43.039 INFO:tasks.ceph:Generating config... 2024-03-24T10:38:43.040 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-03-24T10:38:43.040 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-03-24T10:38:43.040 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-03-24T10:38:43.040 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-24T10:38:43.040 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-24T10:38:43.040 INFO:tasks.ceph:[client] debug client = 20 2024-03-24T10:38:43.040 INFO:tasks.ceph:[client] debug ms = 1 2024-03-24T10:38:43.040 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-24T10:38:43.040 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-24T10:38:43.040 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-24T10:38:43.041 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-24T10:38:43.042 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-24T10:38:43.042 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-24T10:38:43.042 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-24T10:38:43.042 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-24T10:38:43.043 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-24T10:38:43.043 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-24T10:38:43.043 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-24T10:38:43.043 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-24T10:38:43.043 INFO:tasks.ceph:Setting up mon.a... 2024-03-24T10:38:43.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-24T10:38:43.457 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-03-24T10:38:43.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-24T10:38:43.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:38:43.569 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.c', '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]')] 2024-03-24T10:38:43.570 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-24T10:38:43.571 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:43.571 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-24T10:38:43.628 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv b '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --addv c '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:43.697 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 130: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 7ccdf8d1-529f-44dc-adcb-8e62b7bebc17 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 7ccdf8d1-529f-44dc-adcb-8e62b7bebc17 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-03-24 10:38:43.733905 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-03-24 10:38:43.733905 2024-03-24T10:38:43.733 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 0 (unknown) 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.b 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] mon.c 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-24T10:38:43.735 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-24T10:38:43.793 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7ccdf8d1-529f-44dc-adcb-8e62b7bebc17... 2024-03-24T10:38:43.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-24T10:38:43.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-24T10:38:43.877 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-03-24T10:38:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on pool no app = False 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: ms bind msgr2 = False 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn min per osd = 0 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 7ccdf8d1-529f-44dc-adcb-8e62b7bebc17 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-03-24T10:38:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-03-24T10:38:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-24T10:38:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-24T10:38:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: mon down mkfs grace = 300 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-24T10:38:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-03-24T10:38:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-03-24T10:38:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-24T10:38:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-24T10:38:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-24T10:38:43.948 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-03-24T10:38:43.948 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-03-24T10:38:43.948 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-24T10:38:43.948 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-03-24T10:38:43.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-03-24T10:38:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-03-24T10:38:43.950 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-03-24T10:38:43.951 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on pool no app = False 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: ms bind msgr2 = False 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn min per osd = 0 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 7ccdf8d1-529f-44dc-adcb-8e62b7bebc17 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-03-24T10:38:43.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-03-24T10:38:43.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-03-24T10:38:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-03-24T10:38:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-03-24T10:38:43.957 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-03-24T10:38:43.959 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-03-24T10:38:43.975 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-24T10:38:43.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-24T10:38:44.049 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-24T10:38:44.050 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:44.050 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-24T10:38:44.067 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:44.068 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-24T10:38:44.126 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:38:44.126 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:44.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-24T10:38:44.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:38:44.202 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:44.202 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:44.261 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-03-24T10:38:44.261 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:44.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-24T10:38:44.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:38:44.351 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:38:44.351 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:44.435 INFO:tasks.ceph:Setting up mon nodes... 2024-03-24T10:38:44.435 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-24T10:38:44.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-24T10:38:44.508 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-24T10:38:44.511 INFO:tasks.ceph:Setting up mds nodes... 2024-03-24T10:38:44.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-24T10:38:44.583 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-24T10:38:44.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-24T10:38:44.612 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-24T10:38:44.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-24T10:38:44.919 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-24T10:38:44.951 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-24T10:38:44.951 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-03-24T10:38:44.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-24T10:38:44.979 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:38:44.979 INFO:tasks.ceph:role: osd.0 2024-03-24T10:38:44.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:38:44.979 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:38:45.054 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:38:45.485 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-24T10:38:45.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-24T10:38:45.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-24T10:38:45.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-24T10:38:45.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-24T10:38:45.752 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:38:45.752 INFO:tasks.ceph:role: osd.1 2024-03-24T10:38:45.753 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:38:45.753 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-24T10:38:45.827 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:38:45.827 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:38:45.827 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:38:45.827 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:38:45.828 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:38:46.266 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-24T10:38:46.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-24T10:38:46.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-24T10:38:46.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-24T10:38:46.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-24T10:38:46.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:38:46.479 INFO:tasks.ceph:role: osd.2 2024-03-24T10:38:46.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:38:46.480 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-24T10:38:46.554 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-24T10:38:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:38:46.556 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:38:47.004 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-24T10:38:47.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-24T10:38:47.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-24T10:38:47.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-24T10:38:47.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-24T10:38:47.284 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:38:47.284 INFO:tasks.ceph:role: osd.3 2024-03-24T10:38:47.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:38:47.286 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-24T10:38:47.360 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:38:47.361 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:38:47.808 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-24T10:38:47.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-24T10:38:47.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-24T10:38:47.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-24T10:38:48.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.111 7fecf1492dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.111 7fecf1492dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.111 7fecf1492dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.111 7fecf1492dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.111 7fecf1492dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:38:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:48.112 7fecf1492dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-24T10:38:50.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-24T10:38:51.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:51.110 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.137 7fde8f4f4dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.137 7fde8f4f4dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.138 7fde8f4f4dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.138 7fde8f4f4dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.138 7fde8f4f4dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:38:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:51.138 7fde8f4f4dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-24T10:38:53.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-24T10:38:54.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:54.084 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.110 7fe1fb6efdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.110 7fe1fb6efdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.111 7fe1fb6efdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.111 7fe1fb6efdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.111 7fe1fb6efdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:38:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:54.111 7fe1fb6efdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-24T10:38:56.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-24T10:38:57.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:38:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.124 7f7ca9641dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.124 7f7ca9641dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.124 7f7ca9641dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.124 7f7ca9641dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.124 7f7ca9641dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:38:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:38:57.125 7f7ca9641dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-24T10:38:59.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-24T10:38:59.998 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-24T10:38:59.999 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:38:59.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-24T10:39:00.071 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:00.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-24T10:39:00.140 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:00.140 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-24T10:39:00.208 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:00.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-24T10:39:00.275 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:00.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-24T10:39:00.342 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:00.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-24T10:39:00.409 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:39:00.410 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-24T10:39:00.460 INFO:tasks.ceph:Adding keys to all mons... 2024-03-24T10:39:00.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-24T10:39:00.486 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC0AgBmXOJXHhAA7xfiRrK1z7FOyphG0TQY8A== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC0AgBmUJHKIhAAl4h/Uw6wCB7id6j7kmHh+w== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4AgBm32KxBhAAvFLoF3BV6iQc1/xAr8upqQ== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC7AgBmI3JPCBAAMl2jhH6F3pW9clY81dUJwg== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC+AgBmxjWzBhAAdJQ5U87w2UXDxTmVjrSulw== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDBAgBmFyaEBxAABdOTtNiEEFOZm3twCUdQmA== 2024-03-24T10:39:00.487 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-03-24T10:39:00.488 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC0AgBmd3PYNhAAgO9xCWK0IwIO/3SLOIT7yQ== 2024-03-24T10:39:00.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-24T10:39:00.600 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:39:00.674 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:39:00.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:39:00.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:39:00.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:39:00.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:39:01.034 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-24T10:39:01.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-24T10:39:01.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:39:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-24T10:39:01.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-24T10:39:01.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:39:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-24T10:39:01.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-24T10:39:01.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:39:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-24T10:39:01.751 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:39:01.810 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-24T10:39:01.810 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-24T10:39:01.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-24T10:39:01.852 INFO:tasks.ceph.mon.a:Started 2024-03-24T10:39:01.852 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-24T10:39:01.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-24T10:39:01.854 INFO:tasks.ceph.mon.b:Started 2024-03-24T10:39:01.854 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-24T10:39:01.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-24T10:39:01.856 INFO:tasks.ceph.mon.c:Started 2024-03-24T10:39:01.856 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-24T10:39:01.856 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-24T10:39:01.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-24T10:39:01.858 INFO:tasks.ceph.mgr.x:Started 2024-03-24T10:39:01.858 INFO:tasks.ceph:Setting crush tunables to default 2024-03-24T10:39:01.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-03-24T10:39:01.930 INFO:tasks.ceph.mon.a.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.932 INFO:tasks.ceph.mon.c.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.932 INFO:tasks.ceph.mon.b.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:01.959 INFO:tasks.ceph.mgr.x.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.013 7f1e11d77700 1 Processor -- start 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.013 7f1e11d77700 1 -- start start 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e11d77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 0x7f1e0c0f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e11d77700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 0x7f1e0c10e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e11d77700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c0f9210 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e11d77700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c10f0c0 con 0x7f1e0c0f5900 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e11d77700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c1ac660 con 0x7f1e0c0f1ea0 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0aab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 0x7f1e0c0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0a2b1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 0x7f1e0c10e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0b2b3700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e0c0f22f0 0x7f1e0c10e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53950/0 (socket says 172.21.15.73:53950) 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0b2b3700 1 -- 172.21.15.73:0/1949750609 learned_addr learned my addr 172.21.15.73:0/1949750609 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0aab2700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 msgr2=0x7f1e0c0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0aab2700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 msgr2=0x7f1e0c0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 0x7f1e0c0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0a2b1700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 msgr2=0x7f1e0c10e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0a2b1700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 msgr2=0x7f1e0c10e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0a2b1700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 0x7f1e0c10e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 0x7f1e0c0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-24T10:39:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.014 7f1e0a2b1700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 0x7f1e0c10e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-24T10:39:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522189392 0 0) 0x7f1e04001490 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003270 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1040544126 0 0) 0x7f1e04001960 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 msgr2=0x7f1e0c10e290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0f1ea0 0x7f1e0c10e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 msgr2=0x7f1e0c0f1870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.194 7f1e09ab0700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0f5900 0x7f1e0c0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c1ac810 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2989235978 0 0) 0x7f1e04001ec0 con 0x7f1e0c0f22f0 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 >> v1:172.21.15.73:6789/0 conn(0x7f1e0c0f22f0 legacy=0x7f1e0c10e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 0x7f1df0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1df00045d0 0x7f1df0004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1df0009810 0x7f1df000bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c10f0c0 con 0x7f1df0003920 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c1ac660 con 0x7f1df00045d0 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df000c2a0 con 0x7f1df0009810 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 0x7f1df0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0a2b1700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1df00045d0 0x7f1df0004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0b2b3700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1df0009810 0x7f1df000bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1df0009810 msgr2=0x7f1df000bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1df0009810 0x7f1df000bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1df00045d0 msgr2=0x7f1df0004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1df00045d0 0x7f1df0004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 -- 172.21.15.73:0/1949750609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df000c4b0 con 0x7f1df0003920 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e0aab2700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 0x7f1df0003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1e00000e90 tx=0x7f1e00006da0).ready entity=mon.0 client_cookie=e7c9ce0f44ccc8d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1df000c4b0 con 0x7f1df0003920 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00013670 con 0x7f1df0003920 2024-03-24T10:39:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e09ab0700 1 -- 172.21.15.73:0/1949750609 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e0000f040 con 0x7f1df0003920 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e11d77700 1 -- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 msgr2=0x7f1df0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.195 7f1e11d77700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 0x7f1df0003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1e00000e90 tx=0x7f1e00006da0).stop 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 -- 172.21.15.73:0/1949750609 shutdown_connections 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1df0009810 0x7f1df000bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1df00045d0 0x7f1df0004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 --2- 172.21.15.73:0/1949750609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1df0003920 0x7f1df0003dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 -- 172.21.15.73:0/1949750609 >> 172.21.15.73:0/1949750609 conn(0x7f1e0c113a50 msgr2=0x7f1e0c0f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 -- 172.21.15.73:0/1949750609 shutdown_connections 2024-03-24T10:39:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.196 7f1e11d77700 1 -- 172.21.15.73:0/1949750609 wait complete. 2024-03-24T10:39:02.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.219 7f1e11d77700 1 Processor -- start 2024-03-24T10:39:02.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.219 7f1e11d77700 1 -- start start 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0d7c30 0x7f1e0c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 0x7f1e0c1b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c088e30 con 0x7f1e0c0cea20 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c088fe0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e11d77700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0c2bf0 con 0x7f1e0c0d7c30 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0a2b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 0x7f1e0c1b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:59230/0 (socket says 172.21.15.73:59230) 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 -- 172.21.15.73:0/1305919088 learned_addr learned my addr 172.21.15.73:0/1305919088 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0a2b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 0x7f1e0c1b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44956/0 (socket says 172.21.15.73:44956) 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0aab2700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0d7c30 0x7f1e0c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 -- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0d7c30 msgr2=0x7f1e0c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0d7c30 0x7f1e0c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 -- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 msgr2=0x7f1e0c1b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 0x7f1e0c1b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 -- 172.21.15.73:0/1305919088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0c47a0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.220 7f1e0b2b3700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1e0c0bc870 tx=0x7f1e04007580).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e0c0c47a0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04011070 con 0x7f1e0c0cee70 2024-03-24T10:39:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e0c1ac810 con 0x7f1e0c0cee70 2024-03-24T10:39:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c1b4ea0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c1bb930 con 0x7f1e0c0cee70 2024-03-24T10:39:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1e0401c060 con 0x7f1e0c0cee70 2024-03-24T10:39:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.221 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1e0401e440 con 0x7f1e0c0cee70 2024-03-24T10:39:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.222 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c0f08c0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.224 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f1e0400e3e0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.288 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1e0c1aea30 con 0x7f1e0c0cee70 2024-03-24T10:39:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.302 7f1dfbfff700 1 -- 172.21.15.73:0/1305919088 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1e0c1145d0 con 0x7f1e0c0cee70 2024-03-24T10:39:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 msgr2=0x7f1e0c1b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1e0c0bc870 tx=0x7f1e04007580).stop 2024-03-24T10:39:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 shutdown_connections 2024-03-24T10:39:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e0c0cee70 0x7f1e0c1b4870 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e0c0d7c30 0x7f1e0c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 --2- 172.21.15.73:0/1305919088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e0c0cea20 0x7f1e0c1b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.303 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 >> 172.21.15.73:0/1305919088 conn(0x7f1e0c0bd340 msgr2=0x7f1e0c0d84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.304 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 shutdown_connections 2024-03-24T10:39:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.304 7f1e11d77700 1 -- 172.21.15.73:0/1305919088 wait complete. 2024-03-24T10:39:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-03-24T10:39:02.315 INFO:tasks.ceph:check_enable_crimson: False 2024-03-24T10:39:02.315 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-24T10:39:02.315 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:02.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-24T10:39:02.344 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:02.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-24T10:39:02.412 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:02.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-24T10:39:02.480 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-24T10:39:02.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-24T10:39:02.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 37db992e-449a-4d2e-b515-f07fdcf73249 0 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 Processor -- start 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 -- start start 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 0x7f3ce810e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ce80f22f0 0x7f3ce810e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80f9210 con 0x7f3ce80f22f0 2024-03-24T10:39:02.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce810eef0 con 0x7f3ce80f1ea0 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ced167700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce81aa640 con 0x7f3ce80f5900 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ce5dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3cdffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 0x7f3ce810e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ce5dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52806/0 (socket says 172.21.15.73:52806) 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ce65fd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ce80f22f0 0x7f3ce810e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.712 7f3ce5dfc700 1 -- 172.21.15.73:0/1639757193 learned_addr learned my addr 172.21.15.73:0/1639757193 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 -- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 msgr2=0x7f3ce810e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 0x7f3ce810e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 -- 172.21.15.73:0/1639757193 >> v2:172.21.15.73:3300/0 conn(0x7f3ce80f22f0 msgr2=0x7f3ce810e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 --2- 172.21.15.73:0/1639757193 >> v2:172.21.15.73:3300/0 conn(0x7f3ce80f22f0 0x7f3ce810e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 -- 172.21.15.73:0/1639757193 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce81aa7f0 con 0x7f3ce80f5900 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3cdffff700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 0x7f3ce810e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce5dfc700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3cd8002f70 tx=0x7f3cd80099d0).ready entity=mon.2 client_cookie=2607ae7e6c83d660 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce55fb700 1 -- 172.21.15.73:0/1639757193 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3ce81aa7f0 con 0x7f3ce80f5900 2024-03-24T10:39:02.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce55fb700 1 -- 172.21.15.73:0/1639757193 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800f510 con 0x7f3ce80f5900 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ce55fb700 1 -- 172.21.15.73:0/1639757193 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cd800f6f0 con 0x7f3ce80f5900 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ced167700 1 -- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 msgr2=0x7f3ce80f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.713 7f3ced167700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3cd8002f70 tx=0x7f3cd80099d0).stop 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 -- 172.21.15.73:0/1639757193 shutdown_connections 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 --2- 172.21.15.73:0/1639757193 >> v2:172.21.15.73:3300/0 conn(0x7f3ce80f22f0 0x7f3ce810e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80f5900 0x7f3ce80f1870 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 --2- 172.21.15.73:0/1639757193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80f1ea0 0x7f3ce810e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 -- 172.21.15.73:0/1639757193 >> 172.21.15.73:0/1639757193 conn(0x7f3ce8113a50 msgr2=0x7f3ce80f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 -- 172.21.15.73:0/1639757193 shutdown_connections 2024-03-24T10:39:02.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.714 7f3ced167700 1 -- 172.21.15.73:0/1639757193 wait complete. 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 Processor -- start 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 -- start start 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80d88f0 0x7f3ce81bb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80e6540 con 0x7f3ce80d0d10 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80d9f70 con 0x7f3ce80d88f0 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ced167700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80e0860 con 0x7f3ce80d1790 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3cdffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ce5dfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3cdffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52814/0 (socket says 172.21.15.73:52814) 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ce5dfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44966/0 (socket says 172.21.15.73:44966) 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3cdffff700 1 -- 172.21.15.73:0/3874722902 learned_addr learned my addr 172.21.15.73:0/3874722902 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.737 7f3ce65fd700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80d88f0 0x7f3ce81bb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 -- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 msgr2=0x7f3ce80d82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 -- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80d88f0 msgr2=0x7f3ce81bb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80d88f0 0x7f3ce81bb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 -- 172.21.15.73:0/3874722902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80e0bd0 con 0x7f3ce80d0d10 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdffff700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ce5dfc700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3ce80d9810 tx=0x7f3cd80068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3ce80e0bd0 con 0x7f3ce80d0d10 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800fe00 con 0x7f3ce80d0d10 2024-03-24T10:39:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ced167700 1 -- 172.21.15.73:0/3874722902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce80e0400 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cd8011b70 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3ced167700 1 -- 172.21.15.73:0/3874722902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80d8d40 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3cd8019030 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.738 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3cd8018040 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.739 7f3ced167700 1 -- 172.21.15.73:0/3874722902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce80f08c0 con 0x7f3ce80d0d10 2024-03-24T10:39:02.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.741 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f3cd8011770 con 0x7f3ce80d0d10 2024-03-24T10:39:02.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.814 7f3ced167700 1 -- 172.21.15.73:0/3874722902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37db992e-449a-4d2e-b515-f07fdcf73249", "id": 0} v 0) v1 -- 0x7f3ce81ae830 con 0x7f3ce80d0d10 2024-03-24T10:39:02.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.819 7f3cdeffd700 1 -- 172.21.15.73:0/3874722902 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37db992e-449a-4d2e-b515-f07fdcf73249", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cd800f300 con 0x7f3ce80d0d10 2024-03-24T10:39:02.821 INFO:teuthology.orchestra.run.smithi073.stdout:0 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 -- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 msgr2=0x7f3ce80d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3ce80d9810 tx=0x7f3cd80068c0).stop 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 -- 172.21.15.73:0/3874722902 shutdown_connections 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ce80d88f0 0x7f3ce81bb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce80d0d10 0x7f3ce80d1160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 --2- 172.21.15.73:0/3874722902 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3ce80d1790 0x7f3ce80d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.820 7f3ced167700 1 -- 172.21.15.73:0/3874722902 >> 172.21.15.73:0/3874722902 conn(0x7f3ce80de370 msgr2=0x7f3ce80c2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:02.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.821 7f3ced167700 1 -- 172.21.15.73:0/3874722902 shutdown_connections 2024-03-24T10:39:02.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.821 7f3ced167700 1 -- 172.21.15.73:0/3874722902 wait complete. 2024-03-24T10:39:02.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2 1 2024-03-24T10:39:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.957 7f9ab8341700 1 Processor -- start 2024-03-24T10:39:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 -- start start 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 0x7f9ab01a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 0x7f9ab01a8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab01a1d50 con 0x7f9ab00fb090 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab00f2200 con 0x7f9ab010ceb0 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab8341700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0104d90 con 0x7f9ab01a6820 2024-03-24T10:39:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab513c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9ab00fb090 0x7f9ab010c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53954/0 (socket says 172.21.15.73:53954) 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab593d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 0x7f9ab01a8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab513c700 1 -- 172.21.15.73:0/2869130906 learned_addr learned my addr 172.21.15.73:0/2869130906 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.958 7f9ab493b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 0x7f9ab01a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab593d700 1 -- 172.21.15.73:0/2869130906 >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 msgr2=0x7f9ab01a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab593d700 1 --2- 172.21.15.73:0/2869130906 >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 0x7f9ab01a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab593d700 1 -- 172.21.15.73:0/2869130906 >> v1:172.21.15.73:6789/0 conn(0x7f9ab00fb090 legacy=0x7f9ab010c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9aa3fff700 1 -- 172.21.15.73:0/2869130906 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015090033 0 0) 0x7f9aa4001110 con 0x7f9ab00fb090 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab593d700 1 -- 172.21.15.73:0/2869130906 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab01aa2c0 con 0x7f9ab01a6820 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab493b700 1 --2- 172.21.15.73:0/2869130906 >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 0x7f9ab01a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab593d700 1 --2- 172.21.15.73:0/2869130906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 0x7f9ab01a8c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9ab00f58f0 tx=0x7f9aa8009cc0).ready entity=mon.1 client_cookie=e3f83629697a5ed3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9aa3fff700 1 -- 172.21.15.73:0/2869130906 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ab01aa2c0 con 0x7f9ab01a6820 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9aa3fff700 1 -- 172.21.15.73:0/2869130906 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800b840 con 0x7f9ab01a6820 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9aa3fff700 1 -- 172.21.15.73:0/2869130906 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9aa800ba20 con 0x7f9ab01a6820 2024-03-24T10:39:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab8341700 1 -- 172.21.15.73:0/2869130906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 msgr2=0x7f9ab01a8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.959 7f9ab8341700 1 --2- 172.21.15.73:0/2869130906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 0x7f9ab01a8c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9ab00f58f0 tx=0x7f9aa8009cc0).stop 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 -- 172.21.15.73:0/2869130906 shutdown_connections 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 --2- 172.21.15.73:0/2869130906 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab01a6820 0x7f9ab01a8c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 --2- 172.21.15.73:0/2869130906 >> v2:172.21.15.73:3300/0 conn(0x7f9ab010ceb0 0x7f9ab01a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 -- 172.21.15.73:0/2869130906 >> 172.21.15.73:0/2869130906 conn(0x7f9ab01148b0 msgr2=0x7f9ab0114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 -- 172.21.15.73:0/2869130906 shutdown_connections 2024-03-24T10:39:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.960 7f9ab8341700 1 -- 172.21.15.73:0/2869130906 wait complete. 2024-03-24T10:39:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.983 7f9ab8341700 1 Processor -- start 2024-03-24T10:39:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.983 7f9ab8341700 1 -- start start 2024-03-24T10:39:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 0x7f9ab00d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 0x7f9ab01b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00e6540 con 0x7f9ab00d6bd0 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00cacc0 con 0x7f9ab00cb050 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab8341700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00cb4a0 con 0x7f9ab00d6780 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab593d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 0x7f9ab01b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52820/0 (socket says 172.21.15.73:52820) 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab513c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 0x7f9ab00d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 -- 172.21.15.73:0/673832615 learned_addr learned my addr 172.21.15.73:0/673832615 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 -- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 msgr2=0x7f9ab00d6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 0x7f9ab00d6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 -- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 msgr2=0x7f9ab01b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 0x7f9ab01b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 -- 172.21.15.73:0/673832615 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab01b2980 con 0x7f9ab00d6780 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab513c700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 0x7f9ab00d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab593d700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 0x7f9ab01b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.984 7f9ab493b700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9ab00d7740 tx=0x7f9aac00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ab01b2980 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac00ee60 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9aac00f040 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9ab8341700 1 -- 172.21.15.73:0/673832615 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab01b2ca0 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9aac011070 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9ab8341700 1 -- 172.21.15.73:0/673832615 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab01b9700 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.985 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 824+0+0 (secure 0 0 0) 0x7f9aac010040 con 0x7f9ab00d6780 2024-03-24T10:39:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.986 7f9ab8341700 1 -- 172.21.15.73:0/673832615 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab00f0850 con 0x7f9ab00d6780 2024-03-24T10:39:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:02.988 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f9aac00c620 con 0x7f9ab00d6780 2024-03-24T10:39:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.061 7f9ab8341700 1 -- 172.21.15.73:0/673832615 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd new", "uuid": "e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2", "id": 1} v 0) v1 -- 0x7f9ab01ac420 con 0x7f9ab00d6780 2024-03-24T10:39:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.069 7f9aa27fc700 1 -- 172.21.15.73:0/673832615 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9aac000c30 con 0x7f9ab00d6780 2024-03-24T10:39:03.070 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 -- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 msgr2=0x7f9ab01b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9ab00d7740 tx=0x7f9aac00bf70).stop 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 -- 172.21.15.73:0/673832615 shutdown_connections 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ab00d6bd0 0x7f9ab01b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9ab00cb050 0x7f9ab00d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 --2- 172.21.15.73:0/673832615 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9ab00d6780 0x7f9ab01b1d20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 -- 172.21.15.73:0/673832615 >> 172.21.15.73:0/673832615 conn(0x7f9ab00c5820 msgr2=0x7f9ab00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 -- 172.21.15.73:0/673832615 shutdown_connections 2024-03-24T10:39:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.070 7f9ab8341700 1 -- 172.21.15.73:0/673832615 wait complete. 2024-03-24T10:39:03.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 6f4717bb-78f4-490f-bd87-5d635f4bf7bc 2 2024-03-24T10:39:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.209 7f429a282700 1 Processor -- start 2024-03-24T10:39:03.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.209 7f429a282700 1 -- start start 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f429a282700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42940f59f0 0x7f429410b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f429a282700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 0x7f42941a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f429a282700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42941a0a50 con 0x7f429410b720 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f429a282700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42940fa570 con 0x7f42940f59f0 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f429a282700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42941a0c70 con 0x7f429410bb70 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f428bfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f429410b720 0x7f429419fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53962/0 (socket says 172.21.15.73:53962) 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f428bfff700 1 -- 172.21.15.73:0/481102735 learned_addr learned my addr 172.21.15.73:0/481102735 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293001700 1 --2- 172.21.15.73:0/481102735 >> v2:172.21.15.73:3300/0 conn(0x7f42940f59f0 0x7f429410b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293802700 1 --2- 172.21.15.73:0/481102735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 0x7f42941a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4292800700 1 -- 172.21.15.73:0/481102735 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182897056 0 0) 0x7f427c001110 con 0x7f429410b720 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4292800700 1 -- 172.21.15.73:0/481102735 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4274003270 con 0x7f429410b720 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293802700 1 -- 172.21.15.73:0/481102735 >> v2:172.21.15.73:3300/0 conn(0x7f42940f59f0 msgr2=0x7f429410b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293802700 1 --2- 172.21.15.73:0/481102735 >> v2:172.21.15.73:3300/0 conn(0x7f42940f59f0 0x7f429410b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293802700 1 -- 172.21.15.73:0/481102735 >> v1:172.21.15.73:6789/0 conn(0x7f429410b720 legacy=0x7f429419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.210 7f4293802700 1 -- 172.21.15.73:0/481102735 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42941a93b0 con 0x7f429410bb70 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f4293802700 1 --2- 172.21.15.73:0/481102735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 0x7f42941a0420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f42940f47a0 tx=0x7f428c009cc0).ready entity=mon.1 client_cookie=a208a6c1c3d7ebd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f4292800700 1 -- 172.21.15.73:0/481102735 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42941a93b0 con 0x7f429410bb70 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f4292800700 1 -- 172.21.15.73:0/481102735 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00b840 con 0x7f429410bb70 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f4292800700 1 -- 172.21.15.73:0/481102735 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f428c00ba20 con 0x7f429410bb70 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 -- 172.21.15.73:0/481102735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 msgr2=0x7f42941a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 --2- 172.21.15.73:0/481102735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 0x7f42941a0420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f42940f47a0 tx=0x7f428c009cc0).stop 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 -- 172.21.15.73:0/481102735 shutdown_connections 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 --2- 172.21.15.73:0/481102735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f429410bb70 0x7f42941a0420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 --2- 172.21.15.73:0/481102735 >> v2:172.21.15.73:3300/0 conn(0x7f42940f59f0 0x7f429410b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.211 7f429a282700 1 -- 172.21.15.73:0/481102735 >> 172.21.15.73:0/481102735 conn(0x7f4294113a50 msgr2=0x7f42940f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.212 7f429a282700 1 -- 172.21.15.73:0/481102735 shutdown_connections 2024-03-24T10:39:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.212 7f429a282700 1 -- 172.21.15.73:0/481102735 wait complete. 2024-03-24T10:39:03.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 Processor -- start 2024-03-24T10:39:03.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 -- start start 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 0x7f42941a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940deb10 con 0x7f42941a43a0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42941ac5a0 con 0x7f42941a47f0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f429a282700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42941b9a30 con 0x7f42940f18d0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f428bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f4293802700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f428bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44990/0 (socket says 172.21.15.73:44990) 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f428bfff700 1 -- 172.21.15.73:0/666922703 learned_addr learned my addr 172.21.15.73:0/666922703 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f4293802700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:59272/0 (socket says 172.21.15.73:59272) 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.235 7f4293001700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 0x7f42941a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 -- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 msgr2=0x7f42941a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 0x7f42941a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 -- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 msgr2=0x7f42941ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 -- 172.21.15.73:0/666922703 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42941b9be0 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f428bfff700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293001700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 0x7f42941a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4293802700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f42940c50d0 tx=0x7f428c006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42941b9be0 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c011980 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f429a282700 1 -- 172.21.15.73:0/666922703 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42941b9de0 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f428c017040 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f429a282700 1 -- 172.21.15.73:0/666922703 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42941ba1c0 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f428c01c470 con 0x7f42941a47f0 2024-03-24T10:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.236 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 927+0+0 (secure 0 0 0) 0x7f428c018030 con 0x7f42941a47f0 2024-03-24T10:39:03.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.237 7f429a282700 1 -- 172.21.15.73:0/666922703 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42940f08c0 con 0x7f42941a47f0 2024-03-24T10:39:03.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.239 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f428c00b630 con 0x7f42941a47f0 2024-03-24T10:39:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.311 7f429a282700 1 -- 172.21.15.73:0/666922703 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f4717bb-78f4-490f-bd87-5d635f4bf7bc", "id": 2} v 0) v1 -- 0x7f42940ab8c0 con 0x7f42941a47f0 2024-03-24T10:39:03.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.321 7f4290ffd700 1 -- 172.21.15.73:0/666922703 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f4717bb-78f4-490f-bd87-5d635f4bf7bc", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f428c011770 con 0x7f42941a47f0 2024-03-24T10:39:03.323 INFO:teuthology.orchestra.run.smithi073.stdout:2 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 -- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 msgr2=0x7f42941abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f42940c50d0 tx=0x7f428c006c40).stop 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 -- 172.21.15.73:0/666922703 shutdown_connections 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42941a47f0 0x7f42941abf70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f42940f18d0 0x7f42941a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 --2- 172.21.15.73:0/666922703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42941a43a0 0x7f42941ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 -- 172.21.15.73:0/666922703 >> 172.21.15.73:0/666922703 conn(0x7f42940c91b0 msgr2=0x7f42940d6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 -- 172.21.15.73:0/666922703 shutdown_connections 2024-03-24T10:39:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.322 7f429a282700 1 -- 172.21.15.73:0/666922703 wait complete. 2024-03-24T10:39:03.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 326791eb-c8da-481b-9c06-3cc467120ce3 3 2024-03-24T10:39:03.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.462 7f56445f8700 1 Processor -- start 2024-03-24T10:39:03.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.462 7f56445f8700 1 -- start start 2024-03-24T10:39:03.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f563c106510 0x7f563c10e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 0x7f563c0f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0f1e10 con 0x7f563c10eec0 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0fb650 con 0x7f563c106510 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c106960 con 0x7f563c10ea70 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f5640bf2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 0x7f563c0f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f5641bf4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f563c10eec0 0x7f563c0f1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53968/0 (socket says 172.21.15.73:53968) 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f5641bf4700 1 -- 172.21.15.73:0/4219433233 learned_addr learned my addr 172.21.15.73:0/4219433233 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 --2- 172.21.15.73:0/4219433233 >> v2:172.21.15.73:3300/0 conn(0x7f563c106510 0x7f563c10e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 -- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 msgr2=0x7f563c0f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 0x7f563c0f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 -- 172.21.15.73:0/4219433233 >> v1:172.21.15.73:6789/0 conn(0x7f563c10eec0 legacy=0x7f563c0f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 -- 172.21.15.73:0/4219433233 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c1ac7a0 con 0x7f563c106510 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f5640bf2700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 0x7f563c0f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56413f3700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c106510 0x7f563c10e440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f563c0fb800 tx=0x7f563800ba20).ready entity=mon.0 client_cookie=e42ca86f4f1d3945 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f562bfff700 1 -- 172.21.15.73:0/4219433233 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f563c1ac7a0 con 0x7f563c106510 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f562bfff700 1 -- 172.21.15.73:0/4219433233 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800d5c0 con 0x7f563c106510 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f562bfff700 1 -- 172.21.15.73:0/4219433233 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f563800d990 con 0x7f563c106510 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 -- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c106510 msgr2=0x7f563c10e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.463 7f56445f8700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c106510 0x7f563c10e440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f563c0fb800 tx=0x7f563800ba20).stop 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 -- 172.21.15.73:0/4219433233 shutdown_connections 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c106510 0x7f563c10e440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 --2- 172.21.15.73:0/4219433233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c10ea70 0x7f563c0f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 -- 172.21.15.73:0/4219433233 >> 172.21.15.73:0/4219433233 conn(0x7f563c114920 msgr2=0x7f563c114d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 -- 172.21.15.73:0/4219433233 shutdown_connections 2024-03-24T10:39:03.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.464 7f56445f8700 1 -- 172.21.15.73:0/4219433233 wait complete. 2024-03-24T10:39:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 Processor -- start 2024-03-24T10:39:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 -- start start 2024-03-24T10:39:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 0x7f563c1b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0cf810 con 0x7f563c0d6620 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0ce180 con 0x7f563c0cdd30 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.487 7f56445f8700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0cfa40 con 0x7f563c0d6a70 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5641bf4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5640bf2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 0x7f563c1b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5641bf4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52840/0 (socket says 172.21.15.73:52840) 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:59292/0 (socket says 172.21.15.73:59292) 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5641bf4700 1 -- 172.21.15.73:0/455606814 learned_addr learned my addr 172.21.15.73:0/455606814 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 -- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 msgr2=0x7f563c1b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 -- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 msgr2=0x7f563c1b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 0x7f563c1b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 -- 172.21.15.73:0/455606814 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c1b4d00 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5640bf2700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 0x7f563c1b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f5641bf4700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56413f3700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f563c0c2390 tx=0x7f56380068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f563c1b4d00 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56380119c0 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f56445f8700 1 -- 172.21.15.73:0/455606814 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c1b4fc0 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.488 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5638011d90 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.489 7f56445f8700 1 -- 172.21.15.73:0/455606814 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c1bb970 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.489 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5638027460 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.489 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1030+0+0 (secure 0 0 0) 0x7f5638027d70 con 0x7f563c0cdd30 2024-03-24T10:39:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.489 7f56445f8700 1 -- 172.21.15.73:0/455606814 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0f08c0 con 0x7f563c0cdd30 2024-03-24T10:39:03.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.492 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f563800d3b0 con 0x7f563c0cdd30 2024-03-24T10:39:03.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.564 7f56445f8700 1 -- 172.21.15.73:0/455606814 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd new", "uuid": "326791eb-c8da-481b-9c06-3cc467120ce3", "id": 3} v 0) v1 -- 0x7f563c1ae800 con 0x7f563c0cdd30 2024-03-24T10:39:03.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.575 7f562a7fc700 1 -- 172.21.15.73:0/455606814 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "326791eb-c8da-481b-9c06-3cc467120ce3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f56380117b0 con 0x7f563c0cdd30 2024-03-24T10:39:03.576 INFO:teuthology.orchestra.run.smithi073.stdout:3 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 -- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 msgr2=0x7f563c0d5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f563c0c2390 tx=0x7f56380068c0).stop 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 -- 172.21.15.73:0/455606814 shutdown_connections 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f563c0d6a70 0x7f563c1b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f563c0cdd30 0x7f563c0d5ff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 --2- 172.21.15.73:0/455606814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f563c0d6620 0x7f563c1b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 -- 172.21.15.73:0/455606814 >> 172.21.15.73:0/455606814 conn(0x7f563c0e1150 msgr2=0x7f563c0dae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 -- 172.21.15.73:0/455606814 shutdown_connections 2024-03-24T10:39:03.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.576 7f56445f8700 1 -- 172.21.15.73:0/455606814 wait complete. 2024-03-24T10:39:03.587 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-24T10:39:03.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-24T10:39:03.589 INFO:tasks.ceph.osd.0:Started 2024-03-24T10:39:03.590 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-24T10:39:03.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-24T10:39:03.591 INFO:tasks.ceph.osd.1:Started 2024-03-24T10:39:03.592 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-24T10:39:03.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-24T10:39:03.593 INFO:tasks.ceph.osd.2:Started 2024-03-24T10:39:03.594 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-24T10:39:03.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-24T10:39:03.596 INFO:tasks.ceph.osd.3:Started 2024-03-24T10:39:03.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:03.679 INFO:tasks.ceph.osd.2.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:03.679 INFO:tasks.ceph.osd.3.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:03.690 INFO:tasks.ceph.osd.0.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:03.692 INFO:tasks.ceph.osd.1.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:03.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.777 7f1afec06700 1 Processor -- start 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.777 7f1afec06700 1 -- start start 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.777 7f1afec06700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 0x7f1af80f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 0x7f1af810c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af81a94d0 con 0x7f1af80f1fa0 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80f6170 con 0x7f1af80f3540 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af810cf60 con 0x7f1af80f23f0 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af77fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 0x7f1af80f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af6ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1af80f1fa0 0x7f1af810c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53992/0 (socket says 172.21.15.73:53992) 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af6ffd700 1 -- 172.21.15.73:0/945970338 learned_addr learned my addr 172.21.15.73:0/945970338 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 0x7f1af810c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 -- 172.21.15.73:0/945970338 >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 msgr2=0x7f1af80f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 --2- 172.21.15.73:0/945970338 >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 0x7f1af80f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 -- 172.21.15.73:0/945970338 >> v1:172.21.15.73:6789/0 conn(0x7f1af80f1fa0 legacy=0x7f1af810c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 -- 172.21.15.73:0/945970338 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af81aa700 con 0x7f1af80f23f0 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af77fe700 1 --2- 172.21.15.73:0/945970338 >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 0x7f1af80f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af7fff700 1 --2- 172.21.15.73:0/945970338 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 0x7f1af810c930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1af80f4880 tx=0x7f1af000b9a0).ready entity=mon.2 client_cookie=20831445f944113c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af67fc700 1 -- 172.21.15.73:0/945970338 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1af81aa700 con 0x7f1af80f23f0 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af67fc700 1 -- 172.21.15.73:0/945970338 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af000d5c0 con 0x7f1af80f23f0 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1af67fc700 1 -- 172.21.15.73:0/945970338 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1af000d990 con 0x7f1af80f23f0 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 -- 172.21.15.73:0/945970338 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 msgr2=0x7f1af810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.778 7f1afec06700 1 --2- 172.21.15.73:0/945970338 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 0x7f1af810c930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1af80f4880 tx=0x7f1af000b9a0).stop 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 -- 172.21.15.73:0/945970338 shutdown_connections 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 --2- 172.21.15.73:0/945970338 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af80f23f0 0x7f1af810c930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 --2- 172.21.15.73:0/945970338 >> v2:172.21.15.73:3300/0 conn(0x7f1af80f3540 0x7f1af80f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 -- 172.21.15.73:0/945970338 >> 172.21.15.73:0/945970338 conn(0x7f1af8113a80 msgr2=0x7f1af80f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 -- 172.21.15.73:0/945970338 shutdown_connections 2024-03-24T10:39:03.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.779 7f1afec06700 1 -- 172.21.15.73:0/945970338 wait complete. 2024-03-24T10:39:03.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.802 7f1afec06700 1 Processor -- start 2024-03-24T10:39:03.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.802 7f1afec06700 1 -- start start 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 0x7f1af80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80bd8d0 con 0x7f1af80c4290 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80bffe0 con 0x7f1af81ac020 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1afec06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80cfc20 con 0x7f1af81ac470 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45042/0 (socket says 172.21.15.73:45042) 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af6ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 0x7f1af80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 -- 172.21.15.73:0/2258753914 learned_addr learned my addr 172.21.15.73:0/2258753914 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52870/0 (socket says 172.21.15.73:52870) 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 -- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 msgr2=0x7f1af80cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 -- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 msgr2=0x7f1af80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 0x7f1af80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 -- 172.21.15.73:0/2258753914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80cfe50 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af7fff700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af6ffd700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 0x7f1af80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af77fe700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1af81b25b0 tx=0x7f1ae800c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.803 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1af80cfe50 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae800c9c0 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1afec06700 1 -- 172.21.15.73:0/2258753914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80f63a0 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ae800f040 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1afec06700 1 -- 172.21.15.73:0/2258753914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af80f6900 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1ae8022060 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1133+0+0 (secure 0 0 0) 0x7f1ae8010040 con 0x7f1af80c4290 2024-03-24T10:39:03.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.804 7f1afec06700 1 -- 172.21.15.73:0/2258753914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80f08e0 con 0x7f1af80c4290 2024-03-24T10:39:03.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.807 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f1ae800eda0 con 0x7f1af80c4290 2024-03-24T10:39:03.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.866 7f1afec06700 1 -- 172.21.15.73:0/2258753914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1af80e2430 con 0x7f1af80c4290 2024-03-24T10:39:03.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1af4ff9700 1 -- 172.21.15.73:0/2258753914 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3216 (secure 0 0 0) 0x7f1ae8000fb0 con 0x7f1af80c4290 2024-03-24T10:39:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:03.868 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:03.566880","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 -- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 msgr2=0x7f1af81ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1af81b25b0 tx=0x7f1ae800c430).stop 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 -- 172.21.15.73:0/2258753914 shutdown_connections 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1af81ac470 0x7f1af80cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af80c4290 0x7f1af81ab9f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 --2- 172.21.15.73:0/2258753914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1af81ac020 0x7f1af80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.867 7f1afec06700 1 -- 172.21.15.73:0/2258753914 >> 172.21.15.73:0/2258753914 conn(0x7f1af80dd9d0 msgr2=0x7f1af80c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.868 7f1afec06700 1 -- 172.21.15.73:0/2258753914 shutdown_connections 2024-03-24T10:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:03.868 7f1afec06700 1 -- 172.21.15.73:0/2258753914 wait complete. 2024-03-24T10:39:03.879 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-24T10:39:03.880 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-24T10:39:04.272 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-24 10:39:04.271 7fa0e011adc0 -1 Falling back to public interface 2024-03-24T10:39:04.275 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-24 10:39:04.274 7f929743ddc0 -1 Falling back to public interface 2024-03-24T10:39:04.282 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:04.287 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-24 10:39:04.286 7f2cb0f00dc0 -1 Falling back to public interface 2024-03-24T10:39:04.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-24 10:39:04.294 7f4344958dc0 -1 Falling back to public interface 2024-03-24T10:39:04.402 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 Processor -- start 2024-03-24T10:39:04.402 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 -- start start 2024-03-24T10:39:04.402 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 0x7f1cec1a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:04.402 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 0x7f1cec1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec0f9230 con 0x7f1cec0f5920 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0f24e0 con 0x7f1cec0f2090 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf3770700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec1ac720 con 0x7f1cec1a8c80 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1ceb7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 0x7f1cec1a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cf0d6c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 0x7f1cec1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cebfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1cec0f5920 0x7f1cec0f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54008/0 (socket says 172.21.15.73:54008) 2024-03-24T10:39:04.403 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.401 7f1cebfff700 1 -- 172.21.15.73:0/1664544904 learned_addr learned my addr 172.21.15.73:0/1664544904 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1cf0d6c700 1 -- 172.21.15.73:0/1664544904 >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 msgr2=0x7f1cec1a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1cf0d6c700 1 --2- 172.21.15.73:0/1664544904 >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 0x7f1cec1a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1cf0d6c700 1 -- 172.21.15.73:0/1664544904 >> v1:172.21.15.73:6789/0 conn(0x7f1cec0f5920 legacy=0x7f1cec0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1ceaffd700 1 -- 172.21.15.73:0/1664544904 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100175812 0 0) 0x7f1cdc001110 con 0x7f1cec0f5920 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1cf0d6c700 1 -- 172.21.15.73:0/1664544904 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec1ac8d0 con 0x7f1cec1a8c80 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1ceb7fe700 1 --2- 172.21.15.73:0/1664544904 >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 0x7f1cec1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1cf0d6c700 1 --2- 172.21.15.73:0/1664544904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 0x7f1cec1ab0e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce4009c90).ready entity=mon.1 client_cookie=ec2fce64bc72daf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1ceaffd700 1 -- 172.21.15.73:0/1664544904 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cec1ac8d0 con 0x7f1cec1a8c80 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1ceaffd700 1 -- 172.21.15.73:0/1664544904 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400b880 con 0x7f1cec1a8c80 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.402 7f1ceaffd700 1 -- 172.21.15.73:0/1664544904 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ce400ba60 con 0x7f1cec1a8c80 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 -- 172.21.15.73:0/1664544904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 msgr2=0x7f1cec1ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 --2- 172.21.15.73:0/1664544904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 0x7f1cec1ab0e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce4009c90).stop 2024-03-24T10:39:04.405 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 -- 172.21.15.73:0/1664544904 shutdown_connections 2024-03-24T10:39:04.406 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 --2- 172.21.15.73:0/1664544904 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1a8c80 0x7f1cec1ab0e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.406 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 --2- 172.21.15.73:0/1664544904 >> v2:172.21.15.73:3300/0 conn(0x7f1cec0f2090 0x7f1cec1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.406 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 -- 172.21.15.73:0/1664544904 >> 172.21.15.73:0/1664544904 conn(0x7f1cec113a70 msgr2=0x7f1cec0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:04.406 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 -- 172.21.15.73:0/1664544904 shutdown_connections 2024-03-24T10:39:04.406 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.403 7f1cf3770700 1 -- 172.21.15.73:0/1664544904 wait complete. 2024-03-24T10:39:04.426 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.425 7f1cf3770700 1 Processor -- start 2024-03-24T10:39:04.427 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.425 7f1cf3770700 1 -- start start 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 0x7f1cec1b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 0x7f1cec1b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c7820 con 0x7f1cec1b1920 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec1b5ad0 con 0x7f1cec1b5050 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf3770700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0bc860 con 0x7f1cec1b23a0 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf0d6c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 0x7f1cec1b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:52876/0 (socket says 172.21.15.73:52876) 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 -- 172.21.15.73:0/2589400134 learned_addr learned my addr 172.21.15.73:0/2589400134 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:04.429 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cebfff700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 0x7f1cec1b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 -- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 msgr2=0x7f1cec1b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 0x7f1cec1b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 -- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 msgr2=0x7f1cec1b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 0x7f1cec1b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1ceb7fe700 1 -- 172.21.15.73:0/2589400134 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0c7a60 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cebfff700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 0x7f1cec1b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.426 7f1cf0d6c700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 0x7f1cec1b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ceb7fe700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1cec0c25d0 tx=0x7f1ce000eba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cec0c7a60 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000c870 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0bc2a0 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ce000f040 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec1bc3c0 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1ce0011070 con 0x7f1cec1b23a0 2024-03-24T10:39:04.430 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.427 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1133+0+0 (secure 0 0 0) 0x7f1ce0010040 con 0x7f1cec1b23a0 2024-03-24T10:39:04.431 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.428 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0f08e0 con 0x7f1cec1b23a0 2024-03-24T10:39:04.431 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.430 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f1ce000c470 con 0x7f1cec1b23a0 2024-03-24T10:39:04.533 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.532 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cec0cf250 con 0x7f1cec1b23a0 2024-03-24T10:39:04.534 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-24T10:39:04.534 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":6,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:03.566880","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:04.534 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.533 7f1ce97fa700 1 -- 172.21.15.73:0/2589400134 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3216 (secure 0 0 0) 0x7f1ce0000c30 con 0x7f1cec1b23a0 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 msgr2=0x7f1cec1b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1cec0c25d0 tx=0x7f1ce000eba0).stop 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 shutdown_connections 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1cec1b5050 0x7f1cec1b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cec1b1920 0x7f1cec1b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 --2- 172.21.15.73:0/2589400134 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1cec1b23a0 0x7f1cec1b4a20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:04.535 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 >> 172.21.15.73:0/2589400134 conn(0x7f1cec0dc940 msgr2=0x7f1cec0c1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:04.536 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 shutdown_connections 2024-03-24T10:39:04.536 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:04.534 7f1cf3770700 1 -- 172.21.15.73:0/2589400134 wait complete. 2024-03-24T10:39:04.549 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-03-24T10:39:05.584 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-24 10:39:05.584 7fa0e011adc0 -1 osd.3 0 log_to_monitors {default=true} 2024-03-24T10:39:05.600 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-24 10:39:05.600 7f929743ddc0 -1 osd.2 0 log_to_monitors {default=true} 2024-03-24T10:39:05.622 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-24 10:39:05.622 7f2cb0f00dc0 -1 osd.0 0 log_to_monitors {default=true} 2024-03-24T10:39:05.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-24 10:39:05.636 7f4344958dc0 -1 osd.1 0 log_to_monitors {default=true} 2024-03-24T10:39:07.207 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-24 10:39:07.207 7f2c96c1d700 -1 osd.0 0 waiting for initial osdmap 2024-03-24T10:39:07.207 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-24 10:39:07.207 7fa0c5e37700 -1 osd.3 0 waiting for initial osdmap 2024-03-24T10:39:07.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-24 10:39:07.207 7f432a675700 -1 osd.1 0 waiting for initial osdmap 2024-03-24T10:39:07.209 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-24 10:39:07.209 7f927d15a700 -1 osd.2 0 waiting for initial osdmap 2024-03-24T10:39:07.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-24 10:39:07.215 7f4336893700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:39:07.218 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-24 10:39:07.218 7f2ca2e3b700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:39:07.219 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-24 10:39:07.219 7f9289378700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:39:07.219 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-24 10:39:07.219 7fa0d2055700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:39:10.952 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.080 7feda73b9700 1 Processor -- start 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.080 7feda73b9700 1 -- start start 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda73b9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 0x7feda010c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda73b9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 0x7feda00f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda73b9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00f26c0 con 0x7feda010c970 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda73b9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00fa290 con 0x7feda010cdc0 2024-03-24T10:39:11.083 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda73b9700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda00f95c0 con 0x7feda00f5920 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7fed9f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feda010c970 0x7feda00f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39830/0 (socket says 172.21.15.73:39830) 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 0x7feda00f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7fed9ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 0x7feda010c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7fed9f7fe700 1 -- 172.21.15.73:0/2343028645 learned_addr learned my addr 172.21.15.73:0/2343028645 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7fed9effd700 1 -- 172.21.15.73:0/2343028645 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668387687 0 0) 0x7fed90001110 con 0x7feda010c970 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 -- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 msgr2=0x7feda010c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 0x7feda010c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 -- 172.21.15.73:0/2343028645 >> v1:172.21.15.73:6789/0 conn(0x7feda010c970 legacy=0x7feda00f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 -- 172.21.15.73:0/2343028645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda01aa5e0 con 0x7feda010cdc0 2024-03-24T10:39:11.084 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7fed9ffff700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 0x7feda010c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.081 7feda49b5700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 0x7feda00f2090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feda00f6350 tx=0x7fed98009d70).ready entity=mon.1 client_cookie=a443fc4445c06d57 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7fed9effd700 1 -- 172.21.15.73:0/2343028645 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feda01aa5e0 con 0x7feda010cdc0 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7fed9effd700 1 -- 172.21.15.73:0/2343028645 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800b7c0 con 0x7feda010cdc0 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7fed9effd700 1 -- 172.21.15.73:0/2343028645 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9800b9a0 con 0x7feda010cdc0 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 -- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 msgr2=0x7feda00f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 0x7feda00f2090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feda00f6350 tx=0x7fed98009d70).stop 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 -- 172.21.15.73:0/2343028645 shutdown_connections 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda010cdc0 0x7feda00f2090 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 --2- 172.21.15.73:0/2343028645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00f5920 0x7feda010c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 -- 172.21.15.73:0/2343028645 >> 172.21.15.73:0/2343028645 conn(0x7feda0113a70 msgr2=0x7feda00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 -- 172.21.15.73:0/2343028645 shutdown_connections 2024-03-24T10:39:11.085 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.082 7feda73b9700 1 -- 172.21.15.73:0/2343028645 wait complete. 2024-03-24T10:39:11.105 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.105 7feda73b9700 1 Processor -- start 2024-03-24T10:39:11.105 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.105 7feda73b9700 1 -- start start 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00d5a10 0x7feda00db250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 0x7feda00db880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda00dadd0 con 0x7feda00d5e60 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00d9bc0 con 0x7feda00da840 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda73b9700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda00d9ec0 con 0x7feda00d5a10 2024-03-24T10:39:11.108 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7fed9ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7fed9ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42632/0 (socket says 172.21.15.73:42632) 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7feda49b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 0x7feda00db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7fed9ffff700 1 -- 172.21.15.73:0/3519602476 learned_addr learned my addr 172.21.15.73:0/3519602476 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7fed9f7fe700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00d5a10 0x7feda00db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.106 7fed9ffff700 1 -- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00d5a10 msgr2=0x7feda00db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9ffff700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00d5a10 0x7feda00db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9ffff700 1 -- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 msgr2=0x7feda00db880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9ffff700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 0x7feda00db880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9ffff700 1 -- 172.21.15.73:0/3519602476 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00dbeb0 con 0x7feda00da840 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7feda49b5700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 0x7feda00db880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9ffff700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed9400bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feda00dbeb0 con 0x7feda00da840 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400c9a0 con 0x7feda00da840 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7feda73b9700 1 -- 172.21.15.73:0/3519602476 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda01b99e0 con 0x7feda00da840 2024-03-24T10:39:11.109 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9400f040 con 0x7feda00da840 2024-03-24T10:39:11.110 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7feda73b9700 1 -- 172.21.15.73:0/3519602476 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda01b9dc0 con 0x7feda00da840 2024-03-24T10:39:11.110 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fed94011070 con 0x7feda00da840 2024-03-24T10:39:11.110 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.107 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2021+0+0 (secure 0 0 0) 0x7fed94010040 con 0x7feda00da840 2024-03-24T10:39:11.110 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.108 7feda73b9700 1 -- 172.21.15.73:0/3519602476 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda00f08e0 con 0x7feda00da840 2024-03-24T10:39:11.111 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.111 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fed9400c5a0 con 0x7feda00da840 2024-03-24T10:39:11.219 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.219 7feda73b9700 1 -- 172.21.15.73:0/3519602476 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feda00dc170 con 0x7feda00da840 2024-03-24T10:39:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.220 7fed9d7fa700 1 -- 172.21.15.73:0/3519602476 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4504 (secure 0 0 0) 0x7fed94000c30 con 0x7feda00da840 2024-03-24T10:39:11.220 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-24T10:39:11.220 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":9,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:08.204295","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 >> v1:172.21.15.73:6816/43277 conn(0x7fed800145b0 legacy=0x7fed80016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 msgr2=0x7feda00d53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed9400bf70).stop 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 shutdown_connections 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feda00d5e60 0x7feda00db880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feda00da840 0x7feda00d53e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 --2- 172.21.15.73:0/3519602476 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7feda00d5a10 0x7feda00db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 >> 172.21.15.73:0/3519602476 conn(0x7feda00c6d00 msgr2=0x7feda00cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 shutdown_connections 2024-03-24T10:39:11.222 INFO:teuthology.misc.health.smithi073.stderr:2024-03-24 10:39:11.221 7feda73b9700 1 -- 172.21.15.73:0/3519602476 wait complete. 2024-03-24T10:39:11.231 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-03-24T10:39:11.231 INFO:tasks.ceph:Creating RBD pool 2024-03-24T10:39:11.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-24T10:39:11.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.357 7f7c40de7700 1 Processor -- start 2024-03-24T10:39:11.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.357 7f7c40de7700 1 -- start start 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 0x7f7c3c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0fa510 con 0x7f7c3c0f5990 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1a0820 con 0x7f7c3c10b6c0 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1a0a50 con 0x7f7c3c10bb10 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39b64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 0x7f7c3c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c3a365700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c3a365700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49504/0 (socket says 172.21.15.73:49504) 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39b64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43218/0 (socket says 172.21.15.73:43218) 2024-03-24T10:39:11.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c3a365700 1 -- 172.21.15.73:0/3012193551 learned_addr learned my addr 172.21.15.73:0/3012193551 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 -- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 msgr2=0x7f7c3c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 -- 172.21.15.73:0/3012193551 >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 msgr2=0x7f7c3c10b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 --2- 172.21.15.73:0/3012193551 >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 -- 172.21.15.73:0/3012193551 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c1a7330 con 0x7f7c3c10b6c0 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39b64700 1 --2- 172.21.15.73:0/3012193551 >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c3a365700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c39363700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 0x7f7c3c19fbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7c3c0f4740 tx=0x7f7c2c00ba20).ready entity=mon.1 client_cookie=aaa20caabf55a500 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c38b62700 1 -- 172.21.15.73:0/3012193551 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c3c1a7330 con 0x7f7c3c10b6c0 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c38b62700 1 -- 172.21.15.73:0/3012193551 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00d570 con 0x7f7c3c10b6c0 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c38b62700 1 -- 172.21.15.73:0/3012193551 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c2c00d940 con 0x7f7c3c10b6c0 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 -- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 msgr2=0x7f7c3c19fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.358 7f7c40de7700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 0x7f7c3c19fbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7c3c0f4740 tx=0x7f7c2c00ba20).stop 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 -- 172.21.15.73:0/3012193551 shutdown_connections 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c10bb10 0x7f7c3c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 --2- 172.21.15.73:0/3012193551 >> v2:172.21.15.73:3300/0 conn(0x7f7c3c0f5990 0x7f7c3c10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 --2- 172.21.15.73:0/3012193551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c10b6c0 0x7f7c3c19fbc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 -- 172.21.15.73:0/3012193551 >> 172.21.15.73:0/3012193551 conn(0x7f7c3c1139f0 msgr2=0x7f7c3c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:11.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 -- 172.21.15.73:0/3012193551 shutdown_connections 2024-03-24T10:39:11.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.359 7f7c40de7700 1 -- 172.21.15.73:0/3012193551 wait complete. 2024-03-24T10:39:11.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 Processor -- start 2024-03-24T10:39:11.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 -- start start 2024-03-24T10:39:11.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c0d9f20 0x7f7c3c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 0x7f7c3c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0e2e20 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0ddc60 con 0x7f7c3c0d9f20 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c40de7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0dd960 con 0x7f7c3c0cadb0 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c3a365700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 0x7f7c3c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c0d9f20 0x7f7c3c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43232/0 (socket says 172.21.15.73:43232) 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c3a365700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 0x7f7c3c0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49510/0 (socket says 172.21.15.73:49510) 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 -- 172.21.15.73:0/4268448871 learned_addr learned my addr 172.21.15.73:0/4268448871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 -- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 msgr2=0x7f7c3c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 0x7f7c3c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 -- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c0d9f20 msgr2=0x7f7c3c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c0d9f20 0x7f7c3c0ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.382 7f7c39b64700 1 -- 172.21.15.73:0/4268448871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0e2fd0 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c39b64700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7c3c1a8200 tx=0x7f7c3000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c3c0e2fd0 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000c940 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c1a5c60 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c3000f040 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c1bb770 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7c30011070 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.383 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2021+0+0 (secure 0 0 0) 0x7f7c30010040 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.384 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0f0860 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.387 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7c3000c540 con 0x7f7c3c0d94a0 2024-03-24T10:39:11.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:11.492 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7c3c1ae7a0 con 0x7f7c3c0d94a0 2024-03-24T10:39:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.167 7f7c2affd700 1 -- 172.21.15.73:0/4268448871 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7c30000c30 con 0x7f7c3c0d94a0 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 >> v1:172.21.15.73:6816/43277 conn(0x7f7c180145b0 legacy=0x7f7c18016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 msgr2=0x7f7c3c0d98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7c3c1a8200 tx=0x7f7c3000ed00).stop 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 shutdown_connections 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7c3c0cadb0 0x7f7c3c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c3c0d94a0 0x7f7c3c0d98f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 --2- 172.21.15.73:0/4268448871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c3c0d9f20 0x7f7c3c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.169 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 >> 172.21.15.73:0/4268448871 conn(0x7f7c3c0c3b10 msgr2=0x7f7c3c1a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.170 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 shutdown_connections 2024-03-24T10:39:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.170 7f7c40de7700 1 -- 172.21.15.73:0/4268448871 wait complete. 2024-03-24T10:39:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-03-24T10:39:12.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 Processor -- start 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 -- start start 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fec10cf00 con 0x7f7fec0f5890 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec0fa200 con 0x7f7fec1a6b50 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7ff21ec700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0f9530 con 0x7f7fec10cab0 2024-03-24T10:39:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7fea7d8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7feb7da700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7feb7da700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43242/0 (socket says 172.21.15.73:43242) 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7fea7d8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49522/0 (socket says 172.21.15.73:49522) 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7feb7da700 1 -- 172.21.15.73:0/87131318 learned_addr learned my addr 172.21.15.73:0/87131318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.313 7f7feafd9700 1 --1- 172.21.15.73:0/87131318 >> v1:172.21.15.73:6789/0 conn(0x7f7fec0f5890 0x7f7fec10c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39832/0 (socket says 172.21.15.73:39832) 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fea7d8700 1 -- 172.21.15.73:0/87131318 >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 msgr2=0x7f7fec1a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fea7d8700 1 --2- 172.21.15.73:0/87131318 >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fea7d8700 1 -- 172.21.15.73:0/87131318 >> v1:172.21.15.73:6789/0 conn(0x7f7fec0f5890 legacy=0x7f7fec10c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fe9fd7700 1 -- 172.21.15.73:0/87131318 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932423182 0 0) 0x7f7fdc001110 con 0x7f7fec0f5890 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fea7d8700 1 -- 172.21.15.73:0/87131318 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec1aa5f0 con 0x7f7fec10cab0 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7feb7da700 1 --2- 172.21.15.73:0/87131318 >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fea7d8700 1 --2- 172.21.15.73:0/87131318 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7fe0002f70 tx=0x7f7fe000b970).ready entity=mon.2 client_cookie=6b6efdadd9e714be server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fe9fd7700 1 -- 172.21.15.73:0/87131318 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fec1aa5f0 con 0x7f7fec10cab0 2024-03-24T10:39:12.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fe9fd7700 1 -- 172.21.15.73:0/87131318 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000d610 con 0x7f7fec10cab0 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7fe9fd7700 1 -- 172.21.15.73:0/87131318 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fe000d9e0 con 0x7f7fec10cab0 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7ff21ec700 1 -- 172.21.15.73:0/87131318 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 msgr2=0x7f7fec1a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.314 7f7ff21ec700 1 --2- 172.21.15.73:0/87131318 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7fe0002f70 tx=0x7f7fe000b970).stop 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 -- 172.21.15.73:0/87131318 shutdown_connections 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 --2- 172.21.15.73:0/87131318 >> v2:172.21.15.73:3300/0 conn(0x7f7fec1a6b50 0x7f7fec1a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 --2- 172.21.15.73:0/87131318 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec10cab0 0x7f7fec1a6520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 -- 172.21.15.73:0/87131318 >> 172.21.15.73:0/87131318 conn(0x7f7fec1139e0 msgr2=0x7f7fec0f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 -- 172.21.15.73:0/87131318 shutdown_connections 2024-03-24T10:39:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.315 7f7ff21ec700 1 -- 172.21.15.73:0/87131318 wait complete. 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.337 7f7ff21ec700 1 Processor -- start 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.337 7f7ff21ec700 1 -- start start 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.337 7f7ff21ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fec1a6780 0x7f7fec0f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 0x7f7fec1ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0ddde0 con 0x7f7fec0f6d80 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0f8220 con 0x7f7fec1a6780 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec1ae460 con 0x7f7fec0f6930 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fea7d8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 0x7f7fec1ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feafd9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fec1a6780 0x7f7fec0f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fea7d8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49524/0 (socket says 172.21.15.73:49524) 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fea7d8700 1 -- 172.21.15.73:0/548185668 learned_addr learned my addr 172.21.15.73:0/548185668 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 -- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 msgr2=0x7f7fec1ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 -- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fec1a6780 msgr2=0x7f7fec0f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fec1a6780 0x7f7fec0f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 -- 172.21.15.73:0/548185668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec1bb940 con 0x7f7fec0f6d80 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fea7d8700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7feb7da700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 0x7f7fec1ade30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7fec0ddf90 tx=0x7f7fe400ee20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fec1bb940 con 0x7f7fec0f6d80 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400c880 con 0x7f7fec0f6d80 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec1bbb40 con 0x7f7fec0f6d80 2024-03-24T10:39:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fe400f040 con 0x7f7fec0f6d80 2024-03-24T10:39:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.338 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec1bbf20 con 0x7f7fec0f6d80 2024-03-24T10:39:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.339 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7fe4022060 con 0x7f7fec0f6d80 2024-03-24T10:39:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.339 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2363+0+0 (secure 0 0 0) 0x7f7fe4010040 con 0x7f7fec0f6d80 2024-03-24T10:39:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.339 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec0f0850 con 0x7f7fec0f6d80 2024-03-24T10:39:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.343 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7fe400c670 con 0x7f7fec0f6d80 2024-03-24T10:39:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:12.448 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7fec1ae990 con 0x7f7fec0f6d80 2024-03-24T10:39:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.166 7f7fdbfff700 1 -- 172.21.15.73:0/548185668 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7fec114560 con 0x7f7fec0f6d80 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.169 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 >> v1:172.21.15.73:6816/43277 conn(0x7f7fc80145b0 legacy=0x7f7fc8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.169 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 msgr2=0x7f7fec1ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 0x7f7fec1ade30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7fec0ddf90 tx=0x7f7fe400ee20).stop 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 shutdown_connections 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fec0f6d80 0x7f7fec1ade30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fec1a6780 0x7f7fec0f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 --2- 172.21.15.73:0/548185668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fec0f6930 0x7f7fec1ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 >> 172.21.15.73:0/548185668 conn(0x7f7fec0c56b0 msgr2=0x7f7fec0d6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 shutdown_connections 2024-03-24T10:39:13.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.170 7f7ff21ec700 1 -- 172.21.15.73:0/548185668 wait complete. 2024-03-24T10:39:13.175 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-24T10:39:13.187 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-24T10:39:13.187 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-24T10:39:13.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-24T10:39:13.189 INFO:tasks.ceph.mds.a:Started 2024-03-24T10:39:13.189 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-24T10:39:13.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:13.263 INFO:tasks.ceph.mds.a.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:13.314 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.324 7f3cdf776700 1 Processor -- start 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.324 7f3cdf776700 1 -- start start 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.324 7f3cdf776700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 0x7f3cd810e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.324 7f3cdf776700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 0x7f3cd80f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdf776700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80f1e30 con 0x7f3cd810ea90 2024-03-24T10:39:13.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdf776700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80fb650 con 0x7f3cd8106530 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdf776700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8106980 con 0x7f3cd810eee0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 0x7f3cd80f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 0x7f3cd810e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3cd810ea90 0x7f3cd80f1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39850/0 (socket says 172.21.15.73:39850) 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd77fe700 1 -- 172.21.15.73:0/2980683982 learned_addr learned my addr 172.21.15.73:0/2980683982 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 -- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 msgr2=0x7f3cd810e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 0x7f3cd810e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 -- 172.21.15.73:0/2980683982 >> v1:172.21.15.73:6789/0 conn(0x7f3cd810ea90 legacy=0x7f3cd80f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 -- 172.21.15.73:0/2980683982 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd81ac740 con 0x7f3cd810eee0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd7fff700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 0x7f3cd810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdcd72700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 0x7f3cd80f1800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f3cc8001380 tx=0x7f3cc8001080).ready entity=mon.2 client_cookie=1241cabbf1c322b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd6ffd700 1 -- 172.21.15.73:0/2980683982 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cd81ac740 con 0x7f3cd810eee0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd6ffd700 1 -- 172.21.15.73:0/2980683982 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000b740 con 0x7f3cd810eee0 2024-03-24T10:39:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cd6ffd700 1 -- 172.21.15.73:0/2980683982 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cd000b920 con 0x7f3cd810eee0 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdf776700 1 -- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 msgr2=0x7f3cd80f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.325 7f3cdf776700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 0x7f3cd80f1800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f3cc8001380 tx=0x7f3cc8001080).stop 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 -- 172.21.15.73:0/2980683982 shutdown_connections 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd810eee0 0x7f3cd80f1800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 --2- 172.21.15.73:0/2980683982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd8106530 0x7f3cd810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 -- 172.21.15.73:0/2980683982 >> 172.21.15.73:0/2980683982 conn(0x7f3cd8114940 msgr2=0x7f3cd8114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 -- 172.21.15.73:0/2980683982 shutdown_connections 2024-03-24T10:39:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.326 7f3cdf776700 1 -- 172.21.15.73:0/2980683982 wait complete. 2024-03-24T10:39:13.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 Processor -- start 2024-03-24T10:39:13.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 -- start start 2024-03-24T10:39:13.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 0x7f3cd81ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 0x7f3cd81b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c4b40 con 0x7f3cd81adcf0 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80d35f0 con 0x7f3cd81ae770 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdf776700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80d42a0 con 0x7f3cd81b4df0 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cd7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 0x7f3cd81ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cd77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cdcd72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 0x7f3cd81b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cd77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42676/0 (socket says 172.21.15.73:42676) 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cd7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 0x7f3cd81ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43266/0 (socket says 172.21.15.73:43266) 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.349 7f3cd77fe700 1 -- 172.21.15.73:0/3926468380 learned_addr learned my addr 172.21.15.73:0/3926468380 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 -- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 msgr2=0x7f3cd81b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 0x7f3cd81b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 -- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 msgr2=0x7f3cd81ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 0x7f3cd81ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 -- 172.21.15.73:0/3926468380 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd81bbf30 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cdcd72700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 0x7f3cd81b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd77fe700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3cc8001340 tx=0x7f3cc800cb90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cd81bbf30 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8007320 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd81bc130 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cc8005810 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.350 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd81bc510 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.351 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3cc801a060 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.351 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f3cc800bcb0 con 0x7f3cd81ae770 2024-03-24T10:39:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.351 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80d3a60 con 0x7f3cd81ae770 2024-03-24T10:39:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.354 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3cc8007110 con 0x7f3cd81ae770 2024-03-24T10:39:13.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.460 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cd80e0940 con 0x7f3cd81ae770 2024-03-24T10:39:13.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.461 7f3cd57fa700 1 -- 172.21.15.73:0/3926468380 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+5885 (secure 0 0 0) 0x7f3cc8000c30 con 0x7f3cd81ae770 2024-03-24T10:39:13.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:13.461 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:13.162618","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 >> v1:172.21.15.73:6816/43277 conn(0x7f3cb80145b0 legacy=0x7f3cb8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 msgr2=0x7f3cd81b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3cc8001340 tx=0x7f3cc800cb90).stop 2024-03-24T10:39:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 shutdown_connections 2024-03-24T10:39:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3cd81b4df0 0x7f3cd81b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cd81adcf0 0x7f3cd81ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 --2- 172.21.15.73:0/3926468380 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3cd81ae770 0x7f3cd81b47c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 >> 172.21.15.73:0/3926468380 conn(0x7f3cd80c5bc0 msgr2=0x7f3cd81a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 shutdown_connections 2024-03-24T10:39:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.462 7f3cdf776700 1 -- 172.21.15.73:0/3926468380 wait complete. 2024-03-24T10:39:13.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-03-24T10:39:13.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.600 7f3f9b78e700 1 Processor -- start 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 -- start start 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f9410cd70 0x7f3f941a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94104e20 con 0x7f3f941a1400 2024-03-24T10:39:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9410d1c0 con 0x7f3f9410cd70 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f9b78e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940f2290 con 0x7f3f940fb120 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f93fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f93fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42692/0 (socket says 172.21.15.73:42692) 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f93fff700 1 -- 172.21.15.73:0/158250394 learned_addr learned my addr 172.21.15.73:0/158250394 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f937fe700 1 --2- 172.21.15.73:0/158250394 >> v2:172.21.15.73:3300/0 conn(0x7f3f9410cd70 0x7f3f941a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.601 7f3f937fe700 1 -- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 msgr2=0x7f3f9410c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f937fe700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f937fe700 1 -- 172.21.15.73:0/158250394 >> v1:172.21.15.73:6789/0 conn(0x7f3f941a1400 legacy=0x7f3f941a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f937fe700 1 -- 172.21.15.73:0/158250394 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f941aa2b0 con 0x7f3f9410cd70 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f92ffd700 1 -- 172.21.15.73:0/158250394 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671241687 0 0) 0x7f3f8c001490 con 0x7f3f941a1400 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f93fff700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f937fe700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f9410cd70 0x7f3f941a0dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3f88002f70 tx=0x7f3f8800b9f0).ready entity=mon.0 client_cookie=6f0c3da6dd18016d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f92ffd700 1 -- 172.21.15.73:0/158250394 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f941aa2b0 con 0x7f3f9410cd70 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f92ffd700 1 -- 172.21.15.73:0/158250394 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8800d5c0 con 0x7f3f9410cd70 2024-03-24T10:39:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f92ffd700 1 -- 172.21.15.73:0/158250394 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f8800d990 con 0x7f3f9410cd70 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 -- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f9410cd70 msgr2=0x7f3f941a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f9410cd70 0x7f3f941a0dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3f88002f70 tx=0x7f3f8800b9f0).stop 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 -- 172.21.15.73:0/158250394 shutdown_connections 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f940fb120 0x7f3f9410c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 --2- 172.21.15.73:0/158250394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f9410cd70 0x7f3f941a0dd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 -- 172.21.15.73:0/158250394 >> 172.21.15.73:0/158250394 conn(0x7f3f94114940 msgr2=0x7f3f94114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 -- 172.21.15.73:0/158250394 shutdown_connections 2024-03-24T10:39:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.602 7f3f9b78e700 1 -- 172.21.15.73:0/158250394 wait complete. 2024-03-24T10:39:13.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.625 7f3f9b78e700 1 Processor -- start 2024-03-24T10:39:13.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.625 7f3f9b78e700 1 -- start start 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 0x7f3f941b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f941b4ce0 0x7f3f941b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c82a0 con 0x7f3f941adcb0 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940f4320 con 0x7f3f941ae730 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f9b78e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941b5760 con 0x7f3f941b4ce0 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f937fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 0x7f3f941b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43296/0 (socket says 172.21.15.73:43296) 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f93fff700 1 -- 172.21.15.73:0/360421519 learned_addr learned my addr 172.21.15.73:0/360421519 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.626 7f3f98d8a700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f941b4ce0 0x7f3f941b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 -- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f941b4ce0 msgr2=0x7f3f941b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f941b4ce0 0x7f3f941b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 -- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 msgr2=0x7f3f941b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 0x7f3f941b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 -- 172.21.15.73:0/360421519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940dede0 con 0x7f3f941adcb0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f937fe700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 0x7f3f941b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f93fff700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3f941b1140 tx=0x7f3f8400ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f940dede0 con 0x7f3f941adcb0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400ee40 con 0x7f3f941adcb0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f940f4600 con 0x7f3f941adcb0 2024-03-24T10:39:13.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f8400f040 con 0x7f3f941adcb0 2024-03-24T10:39:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941bc090 con 0x7f3f941adcb0 2024-03-24T10:39:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3f84011070 con 0x7f3f941adcb0 2024-03-24T10:39:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.627 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f3f84010040 con 0x7f3f941adcb0 2024-03-24T10:39:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.628 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940f08e0 con 0x7f3f941adcb0 2024-03-24T10:39:13.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.631 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3f8400c5a0 con 0x7f3f941adcb0 2024-03-24T10:39:13.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.739 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f941aedd0 con 0x7f3f941adcb0 2024-03-24T10:39:13.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.740 7f3f917fa700 1 -- 172.21.15.73:0/360421519 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f84000c30 con 0x7f3f941adcb0 2024-03-24T10:39:13.740 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:13.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 >> v1:172.21.15.73:6816/43277 conn(0x7f3f740145b0 legacy=0x7f3f74016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 msgr2=0x7f3f941ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3f941b1140 tx=0x7f3f8400ed00).stop 2024-03-24T10:39:13.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 shutdown_connections 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f941b4ce0 0x7f3f941b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f941adcb0 0x7f3f941ae100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 --2- 172.21.15.73:0/360421519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f941ae730 0x7f3f941b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 >> 172.21.15.73:0/360421519 conn(0x7f3f941a59b0 msgr2=0x7f3f941a6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 shutdown_connections 2024-03-24T10:39:13.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.741 7f3f9b78e700 1 -- 172.21.15.73:0/360421519 wait complete. 2024-03-24T10:39:13.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:13.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.878 7f44ddd1f700 1 Processor -- start 2024-03-24T10:39:13.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.878 7f44ddd1f700 1 -- start start 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 0x7f44d810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80f9230 con 0x7f44d80f5920 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d810ef10 con 0x7f44d80f1ec0 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44ddd1f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81aa660 con 0x7f44d80f2310 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d62b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 0x7f44d810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d6ab2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d6ab2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43302/0 (socket says 172.21.15.73:43302) 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d62b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 0x7f44d810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42708/0 (socket says 172.21.15.73:42708) 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49574/0 (socket says 172.21.15.73:49574) 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d6ab2700 1 -- 172.21.15.73:0/237470227 learned_addr learned my addr 172.21.15.73:0/237470227 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 -- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 msgr2=0x7f44d810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 --2- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 0x7f44d810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 -- 172.21.15.73:0/237470227 >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 msgr2=0x7f44d80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 --2- 172.21.15.73:0/237470227 >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 -- 172.21.15.73:0/237470227 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d81aa810 con 0x7f44d80f2310 2024-03-24T10:39:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d6ab2700 1 --2- 172.21.15.73:0/237470227 >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.879 7f44d72b3700 1 --2- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f44d00032f0 tx=0x7f44d0009c90).ready entity=mon.2 client_cookie=1af9c3ac1b5432b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44d5ab0700 1 -- 172.21.15.73:0/237470227 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44d81aa810 con 0x7f44d80f2310 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44d5ab0700 1 -- 172.21.15.73:0/237470227 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000b880 con 0x7f44d80f2310 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44d5ab0700 1 -- 172.21.15.73:0/237470227 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44d000ba60 con 0x7f44d80f2310 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 -- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 msgr2=0x7f44d810e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 --2- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f44d00032f0 tx=0x7f44d0009c90).stop 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 -- 172.21.15.73:0/237470227 shutdown_connections 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 --2- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d80f2310 0x7f44d810e8e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 --2- 172.21.15.73:0/237470227 >> v2:172.21.15.73:3300/0 conn(0x7f44d80f5920 0x7f44d80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 --2- 172.21.15.73:0/237470227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d80f1ec0 0x7f44d810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 -- 172.21.15.73:0/237470227 >> 172.21.15.73:0/237470227 conn(0x7f44d8113a70 msgr2=0x7f44d80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 -- 172.21.15.73:0/237470227 shutdown_connections 2024-03-24T10:39:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.880 7f44ddd1f700 1 -- 172.21.15.73:0/237470227 wait complete. 2024-03-24T10:39:13.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 Processor -- start 2024-03-24T10:39:13.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 -- start start 2024-03-24T10:39:13.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 0x7f44d81b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 0x7f44d81b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80dc6b0 con 0x7f44d81b4d20 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80dc130 con 0x7f44d81ae650 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44ddd1f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80dcf50 con 0x7f44d81adbd0 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44d6ab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44d62b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 0x7f44d81b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44d6ab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49590/0 (socket says 172.21.15.73:49590) 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44d6ab2700 1 -- 172.21.15.73:0/1309594148 learned_addr learned my addr 172.21.15.73:0/1309594148 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.903 7f44d72b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 0x7f44d81b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:13.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 -- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 msgr2=0x7f44d81b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 0x7f44d81b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 -- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 msgr2=0x7f44d81b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 0x7f44d81b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 -- 172.21.15.73:0/1309594148 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d81bbde0 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d62b1700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 0x7f44d81b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d72b3700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 0x7f44d81b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44d6ab2700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f44c800c000 tx=0x7f44c800ea10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44d81bbde0 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8012600 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d81bbfe0 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44c800f040 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.904 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d81bc3c0 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.905 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f44c8022060 con 0x7f44d81adbd0 2024-03-24T10:39:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.905 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f44c8010040 con 0x7f44d81adbd0 2024-03-24T10:39:13.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.905 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d80f08e0 con 0x7f44d81adbd0 2024-03-24T10:39:13.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:13.908 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f44c80123f0 con 0x7f44d81adbd0 2024-03-24T10:39:14.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.046 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44d81aee10 con 0x7f44d81adbd0 2024-03-24T10:39:14.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.046 7f44c7fff700 1 -- 172.21.15.73:0/1309594148 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f44c8000c30 con 0x7f44d81adbd0 2024-03-24T10:39:14.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:14.047 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 >> v1:172.21.15.73:6816/43277 conn(0x7f44b40145b0 legacy=0x7f44b4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 msgr2=0x7f44d81ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f44c800c000 tx=0x7f44c800ea10).stop 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 shutdown_connections 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44d81b4d20 0x7f44d81b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f44d81adbd0 0x7f44d81ae020 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 --2- 172.21.15.73:0/1309594148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f44d81ae650 0x7f44d81b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 >> 172.21.15.73:0/1309594148 conn(0x7f44d80c5c80 msgr2=0x7f44d80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:14.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 shutdown_connections 2024-03-24T10:39:14.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:14.047 7f44ddd1f700 1 -- 172.21.15.73:0/1309594148 wait complete. 2024-03-24T10:39:14.049 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 1 2024-03-24T10:39:16.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.199 7fdce1ead700 1 Processor -- start 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.199 7fdce1ead700 1 -- start start 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdce1ead700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 0x7fdcdc10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdce1ead700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcdc10bb90 0x7fdcdc1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdce1ead700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc1a0a70 con 0x7fdcdc10b740 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdce1ead700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0fa590 con 0x7fdcdc10bb90 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdce1ead700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a0c90 con 0x7fdcdc0f5a10 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdaab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 0x7fdcdc10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcda2b1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdcdc10b740 0x7fdcdc19fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39874/0 (socket says 172.21.15.73:39874) 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcda2b1700 1 -- 172.21.15.73:0/460498735 learned_addr learned my addr 172.21.15.73:0/460498735 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:16.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdb2b3700 1 --2- 172.21.15.73:0/460498735 >> v2:172.21.15.73:3300/0 conn(0x7fdcdc10bb90 0x7fdcdc1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdaab2700 1 -- 172.21.15.73:0/460498735 >> v2:172.21.15.73:3300/0 conn(0x7fdcdc10bb90 msgr2=0x7fdcdc1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdaab2700 1 --2- 172.21.15.73:0/460498735 >> v2:172.21.15.73:3300/0 conn(0x7fdcdc10bb90 0x7fdcdc1a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcd9ab0700 1 -- 172.21.15.73:0/460498735 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606713961 0 0) 0x7fdcd0001110 con 0x7fdcdc10b740 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdaab2700 1 -- 172.21.15.73:0/460498735 >> v1:172.21.15.73:6789/0 conn(0x7fdcdc10b740 legacy=0x7fdcdc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.200 7fdcdaab2700 1 -- 172.21.15.73:0/460498735 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc1a93d0 con 0x7fdcdc0f5a10 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdcdaab2700 1 --2- 172.21.15.73:0/460498735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 0x7fdcdc10b110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc00b970).ready entity=mon.1 client_cookie=eb9a9e9839dd63be server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdcd9ab0700 1 -- 172.21.15.73:0/460498735 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdcdc1a93d0 con 0x7fdcdc0f5a10 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdcd9ab0700 1 -- 172.21.15.73:0/460498735 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc00d5c0 con 0x7fdcdc0f5a10 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdcd9ab0700 1 -- 172.21.15.73:0/460498735 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdccc00d990 con 0x7fdcdc0f5a10 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 -- 172.21.15.73:0/460498735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 msgr2=0x7fdcdc10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 --2- 172.21.15.73:0/460498735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 0x7fdcdc10b110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc00b970).stop 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 -- 172.21.15.73:0/460498735 shutdown_connections 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 --2- 172.21.15.73:0/460498735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0f5a10 0x7fdcdc10b110 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 --2- 172.21.15.73:0/460498735 >> v2:172.21.15.73:3300/0 conn(0x7fdcdc10bb90 0x7fdcdc1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.201 7fdce1ead700 1 -- 172.21.15.73:0/460498735 >> 172.21.15.73:0/460498735 conn(0x7fdcdc113a70 msgr2=0x7fdcdc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.202 7fdce1ead700 1 -- 172.21.15.73:0/460498735 shutdown_connections 2024-03-24T10:39:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.202 7fdce1ead700 1 -- 172.21.15.73:0/460498735 wait complete. 2024-03-24T10:39:16.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.224 7fdce1ead700 1 Processor -- start 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.224 7fdce1ead700 1 -- start start 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdcdc1b09d0 0x7fdcdc1b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0e6600 con 0x7fdcdc0cee70 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0d6390 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0da8d0 con 0x7fdcdc1b09d0 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcda2b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcda2b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43324/0 (socket says 172.21.15.73:43324) 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42734/0 (socket says 172.21.15.73:42734) 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcda2b1700 1 -- 172.21.15.73:0/2688764671 learned_addr learned my addr 172.21.15.73:0/2688764671 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:16.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdb2b3700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdcdc1b09d0 0x7fdcdc1b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 -- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdcdc1b09d0 msgr2=0x7fdcdc1b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdcdc1b09d0 0x7fdcdc1b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 -- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 msgr2=0x7fdcdc1b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 -- 172.21.15.73:0/2688764671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0d9890 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcda2b1700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdcdaab2700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdcdc0d9890 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc011a00 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc1b7b10 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdccc017040 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.225 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc1b7ef0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.226 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdccc0273b0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.226 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fdccc018070 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.226 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0f08e0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.229 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdccc0117f0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.363 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcdc1aaaa0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.363 7fdccbfff700 1 -- 172.21.15.73:0/2688764671 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7fdccc00d3b0 con 0x7fdcdc0ce3f0 2024-03-24T10:39:16.363 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 >> v1:172.21.15.73:6816/43277 conn(0x7fdcb80145b0 legacy=0x7fdcb8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 msgr2=0x7fdcdc0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdccc002f70 tx=0x7fdccc0068c0).stop 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 shutdown_connections 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdcdc1b09d0 0x7fdcdc1b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdcdc0ce3f0 0x7fdcdc0ce840 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 --2- 172.21.15.73:0/2688764671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcdc0cee70 0x7fdcdc1b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.364 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 >> 172.21.15.73:0/2688764671 conn(0x7fdcdc0e06a0 msgr2=0x7fdcdc1a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.365 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 shutdown_connections 2024-03-24T10:39:16.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:16.365 7fdce1ead700 1 -- 172.21.15.73:0/2688764671 wait complete. 2024-03-24T10:39:16.366 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 1 2024-03-24T10:39:18.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 Processor -- start 2024-03-24T10:39:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 -- start start 2024-03-24T10:39:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 0x7f39101a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39100f9230 con 0x7f39100f5920 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100f24e0 con 0x7f39100f2090 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f391532a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39101ac720 con 0x7f39101a8c80 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f390e85d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f390d85b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 0x7f39101a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f390e05c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f39100f5920 0x7f39100f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39882/0 (socket says 172.21.15.73:39882) 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f390e85d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49616/0 (socket says 172.21.15.73:49616) 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.516 7f390e05c700 1 -- 172.21.15.73:0/731785210 learned_addr learned my addr 172.21.15.73:0/731785210 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390e85d700 1 -- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 msgr2=0x7f39101a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390e85d700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 0x7f39101a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390d05a700 1 -- 172.21.15.73:0/731785210 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059732123 0 0) 0x7f3904001110 con 0x7f39100f5920 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390e85d700 1 -- 172.21.15.73:0/731785210 >> v1:172.21.15.73:6789/0 conn(0x7f39100f5920 legacy=0x7f39100f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390e85d700 1 -- 172.21.15.73:0/731785210 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39101ac8d0 con 0x7f39101a8c80 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390d85b700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 0x7f39101a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390e85d700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f39080032f0 tx=0x7f3908009cc0).ready entity=mon.2 client_cookie=bfcd1374623f0f1b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390d05a700 1 -- 172.21.15.73:0/731785210 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39101ac8d0 con 0x7f39101a8c80 2024-03-24T10:39:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390d05a700 1 -- 172.21.15.73:0/731785210 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800b880 con 0x7f39101a8c80 2024-03-24T10:39:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f390d05a700 1 -- 172.21.15.73:0/731785210 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f390800ba60 con 0x7f39101a8c80 2024-03-24T10:39:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f391532a700 1 -- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 msgr2=0x7f39101ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.517 7f391532a700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f39080032f0 tx=0x7f3908009cc0).stop 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 -- 172.21.15.73:0/731785210 shutdown_connections 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39101a8c80 0x7f39101ab0e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 --2- 172.21.15.73:0/731785210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39100f2090 0x7f39101a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 -- 172.21.15.73:0/731785210 >> 172.21.15.73:0/731785210 conn(0x7f3910113a70 msgr2=0x7f39100f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 -- 172.21.15.73:0/731785210 shutdown_connections 2024-03-24T10:39:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.518 7f391532a700 1 -- 172.21.15.73:0/731785210 wait complete. 2024-03-24T10:39:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 Processor -- start 2024-03-24T10:39:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 -- start start 2024-03-24T10:39:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 0x7f39100cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 0x7f39101bc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.540 7f391532a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100f0250 con 0x7f39101b4cb0 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f391532a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100c7fd0 con 0x7f39101b5730 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f391532a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39100d2750 con 0x7f39100cec10 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390d85b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e05c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 0x7f39100cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390d85b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43338/0 (socket says 172.21.15.73:43338) 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390d85b700 1 -- 172.21.15.73:0/241554119 learned_addr learned my addr 172.21.15.73:0/241554119 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 0x7f39101bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 -- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 msgr2=0x7f39100cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 0x7f39100cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 -- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 msgr2=0x7f39101b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 -- 172.21.15.73:0/241554119 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100d2310 con 0x7f39101b5730 2024-03-24T10:39:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e05c700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 0x7f39100cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390d85b700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f390e85d700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 0x7f39101bc130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3908006fc0 tx=0x7f3908006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39100d2310 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908011ab0 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f391532a700 1 -- 172.21.15.73:0/241554119 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39101b5b80 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3908017040 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.541 7f391532a700 1 -- 172.21.15.73:0/241554119 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39101bc940 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.542 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f390801c470 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.542 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f3908018030 con 0x7f39101b5730 2024-03-24T10:39:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.542 7f391532a700 1 -- 172.21.15.73:0/241554119 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39100f08e0 con 0x7f39101b5730 2024-03-24T10:39:18.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.546 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f390800b670 con 0x7f39101b5730 2024-03-24T10:39:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.681 7f391532a700 1 -- 172.21.15.73:0/241554119 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39100cf890 con 0x7f39101b5730 2024-03-24T10:39:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.681 7f38ff7fe700 1 -- 172.21.15.73:0/241554119 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+776 (secure 0 0 0) 0x7f3908035320 con 0x7f39101b5730 2024-03-24T10:39:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:18.681 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":2}],"filesystems":[]} 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 >> v1:172.21.15.73:6816/43277 conn(0x7f38ec0145b0 legacy=0x7f38ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 msgr2=0x7f39101bc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 0x7f39101bc130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3908006fc0 tx=0x7f3908006c40).stop 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 shutdown_connections 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39101b5730 0x7f39101bc130 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39100cec10 0x7f39100cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 --2- 172.21.15.73:0/241554119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39101b4cb0 0x7f39101b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 >> 172.21.15.73:0/241554119 conn(0x7f39100dcd00 msgr2=0x7f39100c1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 shutdown_connections 2024-03-24T10:39:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.682 7f391532a700 1 -- 172.21.15.73:0/241554119 wait complete. 2024-03-24T10:39:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-03-24T10:39:18.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 Processor -- start 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 -- start start 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f2c0f1ec0 0x7f8f2c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0f9230 con 0x7f8f2c0f2310 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c10f0e0 con 0x7f8f2c0f1ec0 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f340c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1ac680 con 0x7f8f2c0f5920 2024-03-24T10:39:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f30ebe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f30ebe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42746/0 (socket says 172.21.15.73:42746) 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f2bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f2c0f1ec0 0x7f8f2c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f316bf700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8f2c0f2310 0x7f8f2c10e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39896/0 (socket says 172.21.15.73:39896) 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.819 7f8f30ebe700 1 -- 172.21.15.73:0/579517396 learned_addr learned my addr 172.21.15.73:0/579517396 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2b7fe700 1 -- 172.21.15.73:0/579517396 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753806495 0 0) 0x7f8f24001490 con 0x7f8f2c0f2310 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2bfff700 1 -- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 msgr2=0x7f8f2c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2bfff700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2bfff700 1 -- 172.21.15.73:0/579517396 >> v1:172.21.15.73:6789/0 conn(0x7f8f2c0f2310 legacy=0x7f8f2c10e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2bfff700 1 -- 172.21.15.73:0/579517396 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c1ac830 con 0x7f8f2c0f1ec0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f30ebe700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2bfff700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c0f1ec0 0x7f8f2c10e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8f18002f70 tx=0x7f8f1800b9f0).ready entity=mon.0 client_cookie=6839d3ebb82b7e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2b7fe700 1 -- 172.21.15.73:0/579517396 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f2c1ac830 con 0x7f8f2c0f1ec0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2b7fe700 1 -- 172.21.15.73:0/579517396 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1800d5c0 con 0x7f8f2c0f1ec0 2024-03-24T10:39:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f2b7fe700 1 -- 172.21.15.73:0/579517396 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f1800d990 con 0x7f8f2c0f1ec0 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 -- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c0f1ec0 msgr2=0x7f8f2c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c0f1ec0 0x7f8f2c10e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8f18002f70 tx=0x7f8f1800b9f0).stop 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 -- 172.21.15.73:0/579517396 shutdown_connections 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0f5920 0x7f8f2c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 --2- 172.21.15.73:0/579517396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c0f1ec0 0x7f8f2c10e2b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.820 7f8f340c3700 1 -- 172.21.15.73:0/579517396 >> 172.21.15.73:0/579517396 conn(0x7f8f2c113a70 msgr2=0x7f8f2c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.821 7f8f340c3700 1 -- 172.21.15.73:0/579517396 shutdown_connections 2024-03-24T10:39:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.821 7f8f340c3700 1 -- 172.21.15.73:0/579517396 wait complete. 2024-03-24T10:39:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.843 7f8f340c3700 1 Processor -- start 2024-03-24T10:39:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.843 7f8f340c3700 1 -- start start 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f2c1b48b0 0x7f8f2c1b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 0x7f8f2c1bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c5990 con 0x7f8f2c1b5330 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0bc990 con 0x7f8f2c0c4290 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c46e0 con 0x7f8f2c1b48b0 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f316bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 0x7f8f2c1bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43352/0 (socket says 172.21.15.73:43352) 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 -- 172.21.15.73:0/4175094865 learned_addr learned my addr 172.21.15.73:0/4175094865 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f30ebe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f2c1b48b0 0x7f8f2c1b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 -- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f2c1b48b0 msgr2=0x7f8f2c1b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f2c1b48b0 0x7f8f2c1b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 -- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 msgr2=0x7f8f2c1bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 0x7f8f2c1bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 -- 172.21.15.73:0/4175094865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0c4910 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f316bf700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 0x7f8f2c1bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f2bfff700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8f2c0bde90 tx=0x7f8f180068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f2c0c4910 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f180119f0 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f18017040 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c1bc560 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.844 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c1bc940 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.845 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8f18026360 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.845 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f8f18018070 con 0x7f8f2c1b5330 2024-03-24T10:39:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.845 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0c5b40 con 0x7f8f2c1b5330 2024-03-24T10:39:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.849 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8f180117e0 con 0x7f8f2c1b5330 2024-03-24T10:39:18.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.953 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f2c0f08e0 con 0x7f8f2c1b5330 2024-03-24T10:39:18.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.953 7f8f29ffb700 1 -- 172.21.15.73:0/4175094865 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5872 (secure 0 0 0) 0x7f8f1800d3b0 con 0x7f8f2c1b5330 2024-03-24T10:39:18.953 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:18.954 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:14.163821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 >> v1:172.21.15.73:6816/43277 conn(0x7f8f140145b0 legacy=0x7f8f14016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 msgr2=0x7f8f2c0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8f2c0bde90 tx=0x7f8f180068c0).stop 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 shutdown_connections 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f2c0c4290 0x7f8f2c1bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f2c1b48b0 0x7f8f2c1b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 --2- 172.21.15.73:0/4175094865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f2c1b5330 0x7f8f2c0c3c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.954 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 >> 172.21.15.73:0/4175094865 conn(0x7f8f2c0e1060 msgr2=0x7f8f2c0d8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.955 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 shutdown_connections 2024-03-24T10:39:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:18.955 7f8f340c3700 1 -- 172.21.15.73:0/4175094865 wait complete. 2024-03-24T10:39:18.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-03-24T10:39:18.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 Processor -- start 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 -- start start 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f926410b910 0x7f92641a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926410bd60 con 0x7f92640f5a10 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92640fa590 con 0x7f926410b910 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.094 7f92692bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92641a0c50 con 0x7f92641a59d0 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926285d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f926410b910 0x7f92641a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926285d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42774/0 (socket says 172.21.15.73:42774) 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926285d700 1 -- 172.21.15.73:0/519748644 learned_addr learned my addr 172.21.15.73:0/519748644 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926205c700 1 --1- 172.21.15.73:0/519748644 >> v1:172.21.15.73:6789/0 conn(0x7f92640f5a10 0x7f926410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39906/0 (socket says 172.21.15.73:39906) 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 -- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 msgr2=0x7f92641a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 -- 172.21.15.73:0/519748644 >> v1:172.21.15.73:6789/0 conn(0x7f92640f5a10 legacy=0x7f926410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 -- 172.21.15.73:0/519748644 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92641a9470 con 0x7f926410b910 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926105a700 1 -- 172.21.15.73:0/519748644 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840331658 0 0) 0x7f9258001110 con 0x7f92640f5a10 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926285d700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926185b700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926410b910 0x7f92641a53a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9264103a10 tx=0x7f925400ba20).ready entity=mon.0 client_cookie=94f5d475daca3073 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926105a700 1 -- 172.21.15.73:0/519748644 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92641a9470 con 0x7f926410b910 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926105a700 1 -- 172.21.15.73:0/519748644 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925400d5c0 con 0x7f926410b910 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f926105a700 1 -- 172.21.15.73:0/519748644 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f925400d990 con 0x7f926410b910 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f92692bd700 1 -- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926410b910 msgr2=0x7f92641a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.095 7f92692bd700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926410b910 0x7f92641a53a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9264103a10 tx=0x7f925400ba20).stop 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 -- 172.21.15.73:0/519748644 shutdown_connections 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92641a59d0 0x7f92641a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 --2- 172.21.15.73:0/519748644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926410b910 0x7f92641a53a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 -- 172.21.15.73:0/519748644 >> 172.21.15.73:0/519748644 conn(0x7f9264113a70 msgr2=0x7f92640f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 -- 172.21.15.73:0/519748644 shutdown_connections 2024-03-24T10:39:19.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.096 7f92692bd700 1 -- 172.21.15.73:0/519748644 wait complete. 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 Processor -- start 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 -- start start 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 0x7f92641ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 0x7f92641b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92640e6530 con 0x7f92641adff0 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92641a5910 con 0x7f92640c8130 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f92692bd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92641b5090 con 0x7f92641ae440 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f926185b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f926185b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43374/0 (socket says 172.21.15.73:43374) 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f926285d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 0x7f92641b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f926185b700 1 -- 172.21.15.73:0/1459931937 learned_addr learned my addr 172.21.15.73:0/1459931937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.119 7f926205c700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 0x7f92641ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 -- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 msgr2=0x7f92641b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 0x7f92641b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 -- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 msgr2=0x7f92641ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 0x7f92641ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 -- 172.21.15.73:0/1459931937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92641b5270 con 0x7f92641adff0 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926285d700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 0x7f92641b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926205c700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 0x7f92641ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f926185b700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9264103a10 tx=0x7f92540068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92641b5270 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254011980 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92692bd700 1 -- 172.21.15.73:0/1459931937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92641bbb20 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9254011d50 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92692bd700 1 -- 172.21.15.73:0/1459931937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92641bbf00 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.120 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9254027460 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.121 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f925402bb20 con 0x7f92641adff0 2024-03-24T10:39:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.121 7f92692bd700 1 -- 172.21.15.73:0/1459931937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92641aeb50 con 0x7f92641adff0 2024-03-24T10:39:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.124 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9254011770 con 0x7f92641adff0 2024-03-24T10:39:19.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.231 7f92692bd700 1 -- 172.21.15.73:0/1459931937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92640e2430 con 0x7f92641adff0 2024-03-24T10:39:19.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.232 7f92537fe700 1 -- 172.21.15.73:0/1459931937 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f925400d3b0 con 0x7f92641adff0 2024-03-24T10:39:19.232 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 >> v1:172.21.15.73:6816/43277 conn(0x7f92400145b0 legacy=0x7f9240016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 msgr2=0x7f92641b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9264103a10 tx=0x7f92540068c0).stop 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 shutdown_connections 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92641ae440 0x7f92641b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92640c8130 0x7f92641ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 --2- 172.21.15.73:0/1459931937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92641adff0 0x7f92641b4430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 >> 172.21.15.73:0/1459931937 conn(0x7f92640c5710 msgr2=0x7f92640c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 shutdown_connections 2024-03-24T10:39:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.233 7f92692bd700 1 -- 172.21.15.73:0/1459931937 wait complete. 2024-03-24T10:39:19.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 Processor -- start 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 -- start start 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 0x7fe1541a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 0x7fe1540f1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540f21e0 con 0x7fe1540f1730 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541043b0 con 0x7fe15419fdc0 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe15bf78700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540f9750 con 0x7fe1541a0840 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe158d73700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 0x7fe1541a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe153fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 0x7fe1540f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe159574700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe1540f1730 0x7fe1541aa6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39922/0 (socket says 172.21.15.73:39922) 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.371 7fe159574700 1 -- 172.21.15.73:0/1049725146 learned_addr learned my addr 172.21.15.73:0/1049725146 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe1537fe700 1 -- 172.21.15.73:0/1049725146 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412174729 0 0) 0x7fe14c001490 con 0x7fe1540f1730 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe158d73700 1 -- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 msgr2=0x7fe1540f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe158d73700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 0x7fe1540f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe158d73700 1 -- 172.21.15.73:0/1049725146 >> v1:172.21.15.73:6789/0 conn(0x7fe1540f1730 legacy=0x7fe1541aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe158d73700 1 -- 172.21.15.73:0/1049725146 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540f1b80 con 0x7fe15419fdc0 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe153fff700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 0x7fe1540f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe158d73700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 0x7fe1541a0210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe148002f70 tx=0x7fe14800ba20).ready entity=mon.1 client_cookie=6b13de279e6e23ff server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe1537fe700 1 -- 172.21.15.73:0/1049725146 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1540f1b80 con 0x7fe15419fdc0 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe1537fe700 1 -- 172.21.15.73:0/1049725146 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800d570 con 0x7fe15419fdc0 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe1537fe700 1 -- 172.21.15.73:0/1049725146 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe14800d990 con 0x7fe15419fdc0 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe15bf78700 1 -- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 msgr2=0x7fe1541a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.372 7fe15bf78700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 0x7fe1541a0210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe148002f70 tx=0x7fe14800ba20).stop 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 -- 172.21.15.73:0/1049725146 shutdown_connections 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe15419fdc0 0x7fe1541a0210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 --2- 172.21.15.73:0/1049725146 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1541a0840 0x7fe1540f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 -- 172.21.15.73:0/1049725146 >> 172.21.15.73:0/1049725146 conn(0x7fe154112fb0 msgr2=0x7fe154113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 -- 172.21.15.73:0/1049725146 shutdown_connections 2024-03-24T10:39:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.373 7fe15bf78700 1 -- 172.21.15.73:0/1049725146 wait complete. 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.395 7fe15bf78700 1 Processor -- start 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.395 7fe15bf78700 1 -- start start 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.395 7fe15bf78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 0x7fe1541b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1541b4a80 0x7fe1541b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540e5d00 con 0x7fe1540cc410 2024-03-24T10:39:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540cb590 con 0x7fe1541b4a80 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541bb930 con 0x7fe1540d5e40 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43386/0 (socket says 172.21.15.73:43386) 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe159574700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1541b4a80 0x7fe1541b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 -- 172.21.15.73:0/3174419545 learned_addr learned my addr 172.21.15.73:0/3174419545 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe153fff700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 0x7fe1541b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 -- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 msgr2=0x7fe1541b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 0x7fe1541b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 -- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1541b4a80 msgr2=0x7fe1541b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1541b4a80 0x7fe1541b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 -- 172.21.15.73:0/3174419545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1541bbae0 con 0x7fe1540cc410 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe153fff700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 0x7fe1541b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe158d73700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe1540c4c80 tx=0x7fe1480068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1541bbae0 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800d570 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1541bbce0 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe148017040 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.396 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1541bc0c0 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.397 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe148026360 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.397 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fe148018070 con 0x7fe1540cc410 2024-03-24T10:39:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.397 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1540f08e0 con 0x7fe1540cc410 2024-03-24T10:39:19.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.400 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe148011bb0 con 0x7fe1540cc410 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.508 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe1540daeb0 con 0x7fe1540cc410 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.508 7fe151ffb700 1 -- 172.21.15.73:0/3174419545 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+64 (secure 0 0 0) 0x7fe14800d360 con 0x7fe1540cc410 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-03-24T10:39:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2024-03-24T10:39:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:19.509 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 >> v1:172.21.15.73:6816/43277 conn(0x7fe13c0145b0 legacy=0x7fe13c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 msgr2=0x7fe1540d5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe1540c4c80 tx=0x7fe1480068c0).stop 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 shutdown_connections 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1541b4a80 0x7fe1541b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1540cc410 0x7fe1540d5810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 --2- 172.21.15.73:0/3174419545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1540d5e40 0x7fe1541b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 >> 172.21.15.73:0/3174419545 conn(0x7fe1540c6c70 msgr2=0x7fe1540d6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 shutdown_connections 2024-03-24T10:39:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.509 7fe15bf78700 1 -- 172.21.15.73:0/3174419545 wait complete. 2024-03-24T10:39:19.520 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-24T10:39:19.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 Processor -- start 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 -- start start 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 0x7f89740f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89740f2300 0x7f897410eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89740f9220 con 0x7f89740f1eb0 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897410f0d0 con 0x7f89740f2300 2024-03-24T10:39:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f897a3d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89741ac670 con 0x7f89740f5910 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8973086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 0x7f89740f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8973887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89740f2300 0x7f897410eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8972885700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f89740f1eb0 0x7f897410e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39932/0 (socket says 172.21.15.73:39932) 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8972885700 1 -- 172.21.15.73:0/2453686958 learned_addr learned my addr 172.21.15.73:0/2453686958 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8973887700 1 -- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 msgr2=0x7f89740f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8973887700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 0x7f89740f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.649 7f8973887700 1 -- 172.21.15.73:0/2453686958 >> v1:172.21.15.73:6789/0 conn(0x7f89740f1eb0 legacy=0x7f897410e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8972084700 1 -- 172.21.15.73:0/2453686958 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185415127 0 0) 0x7f8964001110 con 0x7f89740f1eb0 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8973887700 1 -- 172.21.15.73:0/2453686958 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89741ac820 con 0x7f89740f2300 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8973086700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 0x7f89740f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8973887700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740f2300 0x7f897410eaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f896c0032f0 tx=0x7f896c009d10).ready entity=mon.0 client_cookie=bd765f14d6e20a9a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8972084700 1 -- 172.21.15.73:0/2453686958 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89741ac820 con 0x7f89740f2300 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8972084700 1 -- 172.21.15.73:0/2453686958 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c00b800 con 0x7f89740f2300 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f8972084700 1 -- 172.21.15.73:0/2453686958 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f896c00b9e0 con 0x7f89740f2300 2024-03-24T10:39:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 -- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740f2300 msgr2=0x7f897410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740f2300 0x7f897410eaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f896c0032f0 tx=0x7f896c009d10).stop 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 -- 172.21.15.73:0/2453686958 shutdown_connections 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740f5910 0x7f89740f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 --2- 172.21.15.73:0/2453686958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740f2300 0x7f897410eaa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 -- 172.21.15.73:0/2453686958 >> 172.21.15.73:0/2453686958 conn(0x7f8974113a60 msgr2=0x7f89740f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 -- 172.21.15.73:0/2453686958 shutdown_connections 2024-03-24T10:39:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.650 7f897a3d1700 1 -- 172.21.15.73:0/2453686958 wait complete. 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 Processor -- start 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 -- start start 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 0x7f89741b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740bc610 con 0x7f89740daf20 2024-03-24T10:39:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89740d6b10 con 0x7f89740da4a0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f897a3d1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89740ceeb0 con 0x7f89741b4ed0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8973086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8973887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8972885700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 0x7f89741b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8973086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:42804/0 (socket says 172.21.15.73:42804) 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8973887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49680/0 (socket says 172.21.15.73:49680) 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.673 7f8973086700 1 -- 172.21.15.73:0/4100164211 learned_addr learned my addr 172.21.15.73:0/4100164211 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 -- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 msgr2=0x7f89741bbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 -- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 msgr2=0x7f89741b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 0x7f89741b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 -- 172.21.15.73:0/4100164211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740d85b0 con 0x7f89740da4a0 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973887700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8972885700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 0x7f89741b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8973086700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f89740cb710 tx=0x7f896800bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89740d85b0 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800c9a0 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89740cf440 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f896800f040 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740d7350 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.674 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8968011070 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.675 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f8968010040 con 0x7f89740da4a0 2024-03-24T10:39:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.675 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89740f08d0 con 0x7f89740da4a0 2024-03-24T10:39:19.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.678 7f8970881700 1 -- 172.21.15.73:0/4100164211 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f896800c5a0 con 0x7f89740da4a0 2024-03-24T10:39:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 >> v1:172.21.15.73:6816/43277 conn(0x7f89540145b0 legacy=0x7f8954016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 msgr2=0x7f89740da8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f89740cb710 tx=0x7f896800bf70).stop 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 shutdown_connections 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f89741b4ed0 0x7f89741bbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89740da4a0 0x7f89740da8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 --2- 172.21.15.73:0/4100164211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740daf20 0x7f89741b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 >> 172.21.15.73:0/4100164211 conn(0x7f89740dc730 msgr2=0x7f89740d8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 shutdown_connections 2024-03-24T10:39:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.784 7f897a3d1700 1 -- 172.21.15.73:0/4100164211 wait complete. 2024-03-24T10:39:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:Invalid command: missing required parameter pg_num() 2024-03-24T10:39:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool create {} {replicated|erasure} {} {} {} {} {} {} {} : create pool 2024-03-24T10:39:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:39:19.797 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:39:19.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 Processor -- start 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 -- start start 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 0x7f48500f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 0x7f485010ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500f91b0 con 0x7f48500f1e40 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485010f060 con 0x7f48500f2290 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f48563e0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48501ac600 con 0x7f48500f58a0 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 0x7f485010ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 0x7f48500f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484e885700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f48500f1e40 0x7f485010e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39948/0 (socket says 172.21.15.73:39948) 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484e885700 1 -- 172.21.15.73:0/1796386335 learned_addr learned my addr 172.21.15.73:0/1796386335 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f887700 1 -- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 msgr2=0x7f48500f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f887700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 0x7f48500f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f887700 1 -- 172.21.15.73:0/1796386335 >> v1:172.21.15.73:6789/0 conn(0x7f48500f1e40 legacy=0x7f485010e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484e084700 1 -- 172.21.15.73:0/1796386335 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438300159 0 0) 0x7f4844001110 con 0x7f48500f1e40 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f887700 1 -- 172.21.15.73:0/1796386335 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48501ac7b0 con 0x7f48500f2290 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.925 7f484f086700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 0x7f48500f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f484f887700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 0x7f485010ea30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4850103770 tx=0x7f4848009d70).ready entity=mon.1 client_cookie=7d0706c6bc819304 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f484e084700 1 -- 172.21.15.73:0/1796386335 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48501ac7b0 con 0x7f48500f2290 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f484e084700 1 -- 172.21.15.73:0/1796386335 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800b7c0 con 0x7f48500f2290 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f484e084700 1 -- 172.21.15.73:0/1796386335 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f484800b9a0 con 0x7f48500f2290 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 -- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 msgr2=0x7f485010ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 0x7f485010ea30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4850103770 tx=0x7f4848009d70).stop 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 -- 172.21.15.73:0/1796386335 shutdown_connections 2024-03-24T10:39:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500f2290 0x7f485010ea30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 --2- 172.21.15.73:0/1796386335 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500f58a0 0x7f48500f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 -- 172.21.15.73:0/1796386335 >> 172.21.15.73:0/1796386335 conn(0x7f48501139f0 msgr2=0x7f48500f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:19.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 -- 172.21.15.73:0/1796386335 shutdown_connections 2024-03-24T10:39:19.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.926 7f48563e0700 1 -- 172.21.15.73:0/1796386335 wait complete. 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.949 7f48563e0700 1 Processor -- start 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.949 7f48563e0700 1 -- start start 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500d21f0 0x7f48501b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48501b4820 0x7f48501b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500c5310 con 0x7f48501b4820 2024-03-24T10:39:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500d36b0 con 0x7f48500d21f0 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48501bb8e0 con 0x7f48500d1770 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484e885700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500d21f0 0x7f48501b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:49704/0 (socket says 172.21.15.73:49704) 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f887700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48501b4820 0x7f48501b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 -- 172.21.15.73:0/1774504674 learned_addr learned my addr 172.21.15.73:0/1774504674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 -- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500d21f0 msgr2=0x7f48501b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500d21f0 0x7f48501b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 -- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48501b4820 msgr2=0x7f48501b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48501b4820 0x7f48501b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 -- 172.21.15.73:0/1774504674 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48501bba90 con 0x7f48500d1770 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484f086700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f484000c000 tx=0x7f484000bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48501bba90 con 0x7f48500d1770 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000c870 con 0x7f48500d1770 2024-03-24T10:39:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 -- 172.21.15.73:0/1774504674 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48501bbc90 con 0x7f48500d1770 2024-03-24T10:39:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f484000f040 con 0x7f48500d1770 2024-03-24T10:39:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.950 7f48563e0700 1 -- 172.21.15.73:0/1774504674 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48501bc070 con 0x7f48500d1770 2024-03-24T10:39:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.951 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4840011070 con 0x7f48500d1770 2024-03-24T10:39:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.951 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f4840010040 con 0x7f48500d1770 2024-03-24T10:39:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.951 7f48563e0700 1 -- 172.21.15.73:0/1774504674 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48500f0860 con 0x7f48500d1770 2024-03-24T10:39:19.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:19.955 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f484000c470 con 0x7f48500d1770 2024-03-24T10:39:20.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.060 7f48563e0700 1 -- 172.21.15.73:0/1774504674 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64} v 0) v1 -- 0x7f48501ae910 con 0x7f48500d1770 2024-03-24T10:39:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.358 7f484c881700 1 -- 172.21.15.73:0/1774504674 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 134+0+0 (secure 0 0 0) 0x7f4840000c30 con 0x7f48500d1770 2024-03-24T10:39:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 >> v1:172.21.15.73:6816/43277 conn(0x7f48300145b0 legacy=0x7f4830016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 msgr2=0x7f48500d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f484000c000 tx=0x7f484000bf70).stop 2024-03-24T10:39:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 shutdown_connections 2024-03-24T10:39:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48501b4820 0x7f48501b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f48500d1770 0x7f48500d1bc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 --2- 172.21.15.73:0/1774504674 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48500d21f0 0x7f48501b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 >> 172.21.15.73:0/1774504674 conn(0x7f48500c5c40 msgr2=0x7f48500bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 shutdown_connections 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.360 7f48563e0700 1 -- 172.21.15.73:0/1774504674 wait complete. 2024-03-24T10:39:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-03-24T10:39:20.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 64 2024-03-24T10:39:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 Processor -- start 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 -- start start 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 0x7fe1041a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10410bd50 con 0x7fe1040f5a00 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040fa580 con 0x7fe10410b900 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe10ac46700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041a0c40 con 0x7fe1041a59c0 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe102ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe103fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 0x7fe1041a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe1037fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe1040f5a00 0x7fe10410b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36328/0 (socket says 172.21.15.73:36328) 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe1037fe700 1 -- 172.21.15.73:0/994862571 learned_addr learned my addr 172.21.15.73:0/994862571 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.508 7fe102ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55974/0 (socket says 172.21.15.73:55974) 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe1027fc700 1 -- 172.21.15.73:0/994862571 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532037500 0 0) 0x7fe0ec001110 con 0x7fe1040f5a00 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe1027fc700 1 -- 172.21.15.73:0/994862571 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e4003270 con 0x7fe1040f5a00 2024-03-24T10:39:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe103fff700 1 -- 172.21.15.73:0/994862571 >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 msgr2=0x7fe1041a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe103fff700 1 --2- 172.21.15.73:0/994862571 >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe103fff700 1 -- 172.21.15.73:0/994862571 >> v1:172.21.15.73:6789/0 conn(0x7fe1040f5a00 legacy=0x7fe10410b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe103fff700 1 -- 172.21.15.73:0/994862571 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040f1880 con 0x7fe1041a59c0 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe102ffd700 1 --2- 172.21.15.73:0/994862571 >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe103fff700 1 --2- 172.21.15.73:0/994862571 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 0x7fe1041a7e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe1040f47b0 tx=0x7fe0fc009cc0).ready entity=mon.2 client_cookie=bf85e76be223fadd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe1027fc700 1 -- 172.21.15.73:0/994862571 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1040f1880 con 0x7fe1041a59c0 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe1027fc700 1 -- 172.21.15.73:0/994862571 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00b840 con 0x7fe1041a59c0 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe1027fc700 1 -- 172.21.15.73:0/994862571 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0fc00ba20 con 0x7fe1041a59c0 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe10ac46700 1 -- 172.21.15.73:0/994862571 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 msgr2=0x7fe1041a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.509 7fe10ac46700 1 --2- 172.21.15.73:0/994862571 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 0x7fe1041a7e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe1040f47b0 tx=0x7fe0fc009cc0).stop 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 -- 172.21.15.73:0/994862571 shutdown_connections 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 --2- 172.21.15.73:0/994862571 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1041a59c0 0x7fe1041a7e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 --2- 172.21.15.73:0/994862571 >> v2:172.21.15.73:3300/0 conn(0x7fe10410b900 0x7fe1041a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 -- 172.21.15.73:0/994862571 >> 172.21.15.73:0/994862571 conn(0x7fe104113a60 msgr2=0x7fe1040f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 -- 172.21.15.73:0/994862571 shutdown_connections 2024-03-24T10:39:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.510 7fe10ac46700 1 -- 172.21.15.73:0/994862571 wait complete. 2024-03-24T10:39:20.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.532 7fe10ac46700 1 Processor -- start 2024-03-24T10:39:20.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.532 7fe10ac46700 1 -- start start 2024-03-24T10:39:20.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040d61c0 con 0x7fe1040c3060 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041b2280 con 0x7fe1040c2c10 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041b24b0 con 0x7fe1040c4d60 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe103fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe102ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46184/0 (socket says 172.21.15.73:46184) 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 -- 172.21.15.73:0/2075762391 learned_addr learned my addr 172.21.15.73:0/2075762391 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe103fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55984/0 (socket says 172.21.15.73:55984) 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe102ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46510/0 (socket says 172.21.15.73:46510) 2024-03-24T10:39:20.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 -- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 msgr2=0x7fe1041b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 -- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 msgr2=0x7fe1041b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 -- 172.21.15.73:0/2075762391 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1041bc150 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe102ffd700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe103fff700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe1037fe700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe0ec000bc0 tx=0x7fe0ec00c760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1041bc150 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0072e0 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0ec005810 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.533 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1040ba200 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.534 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1040ba700 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.534 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe0ec005a10 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.534 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2728+0+0 (secure 0 0 0) 0x7fe0ec014810 con 0x7fe1040c4d60 2024-03-24T10:39:20.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.534 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040bfbf0 con 0x7fe1040c4d60 2024-03-24T10:39:20.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.538 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe0ec0070d0 con 0x7fe1040c4d60 2024-03-24T10:39:20.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:20.642 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7fe1040f08d0 con 0x7fe1040c4d60 2024-03-24T10:39:21.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.374 7fe100ff9700 1 -- 172.21.15.73:0/2075762391 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64}]=0 pool 'cephfs_data' created v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1040fefb0 con 0x7fe1040c4d60 2024-03-24T10:39:21.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.383 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 >> v1:172.21.15.73:6816/43277 conn(0x7fe0e80145b0 legacy=0x7fe0e8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.383 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 msgr2=0x7fe1040c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.383 7fe10ac46700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe0ec000bc0 tx=0x7fe0ec00c760).stop 2024-03-24T10:39:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.385 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 shutdown_connections 2024-03-24T10:39:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.385 7fe10ac46700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1040c3060 0x7fe1041b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.385 7fe10ac46700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe1040c4d60 0x7fe1040c25e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.385 7fe10ac46700 1 --2- 172.21.15.73:0/2075762391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe1040c2c10 0x7fe1041b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.385 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 >> 172.21.15.73:0/2075762391 conn(0x7fe1040e10b0 msgr2=0x7fe1040d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:21.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.387 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 shutdown_connections 2024-03-24T10:39:21.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.388 7fe10ac46700 1 -- 172.21.15.73:0/2075762391 wait complete. 2024-03-24T10:39:21.400 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-03-24T10:39:21.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-24T10:39:21.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 Processor -- start 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 -- start start 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0f26c0 con 0x7f8f9c10c970 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c0fa290 con 0x7f8f9c0f5920 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa37e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0f95c0 con 0x7f8f9c10cdc0 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8f9bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa0ddd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8f9bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55994/0 (socket says 172.21.15.73:55994) 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8fa0ddd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46526/0 (socket says 172.21.15.73:46526) 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8f9bfff700 1 -- 172.21.15.73:0/3918704748 learned_addr learned my addr 172.21.15.73:0/3918704748 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.542 7f8f9b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8f9c10c970 0x7f8f9c0f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36330/0 (socket says 172.21.15.73:36330) 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa0ddd700 1 -- 172.21.15.73:0/3918704748 >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 msgr2=0x7f8f9c10c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa0ddd700 1 --2- 172.21.15.73:0/3918704748 >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa0ddd700 1 -- 172.21.15.73:0/3918704748 >> v1:172.21.15.73:6789/0 conn(0x7f8f9c10c970 legacy=0x7f8f9c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8f9affd700 1 -- 172.21.15.73:0/3918704748 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053497844 0 0) 0x7f8f90001110 con 0x7f8f9c10c970 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa0ddd700 1 -- 172.21.15.73:0/3918704748 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c1aa5e0 con 0x7f8f9c10cdc0 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8f9bfff700 1 --2- 172.21.15.73:0/3918704748 >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa0ddd700 1 --2- 172.21.15.73:0/3918704748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8f9c0f4640 tx=0x7f8f94009cc0).ready entity=mon.1 client_cookie=a93bb56ef91cf9de server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8f9affd700 1 -- 172.21.15.73:0/3918704748 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f9c1aa5e0 con 0x7f8f9c10cdc0 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8f9affd700 1 -- 172.21.15.73:0/3918704748 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400b840 con 0x7f8f9c10cdc0 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8f9affd700 1 -- 172.21.15.73:0/3918704748 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f9400ba20 con 0x7f8f9c10cdc0 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa37e1700 1 -- 172.21.15.73:0/3918704748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 msgr2=0x7f8f9c0f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.543 7f8fa37e1700 1 --2- 172.21.15.73:0/3918704748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8f9c0f4640 tx=0x7f8f94009cc0).stop 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 -- 172.21.15.73:0/3918704748 shutdown_connections 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 --2- 172.21.15.73:0/3918704748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c10cdc0 0x7f8f9c0f2090 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 --2- 172.21.15.73:0/3918704748 >> v2:172.21.15.73:3300/0 conn(0x7f8f9c0f5920 0x7f8f9c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 -- 172.21.15.73:0/3918704748 >> 172.21.15.73:0/3918704748 conn(0x7f8f9c113a70 msgr2=0x7f8f9c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:21.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 -- 172.21.15.73:0/3918704748 shutdown_connections 2024-03-24T10:39:21.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.544 7f8fa37e1700 1 -- 172.21.15.73:0/3918704748 wait complete. 2024-03-24T10:39:21.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.566 7f8fa37e1700 1 Processor -- start 2024-03-24T10:39:21.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 -- start start 2024-03-24T10:39:21.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 0x7f8f9c1b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f9c1abf90 0x7f8f9c1b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0cd620 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0c44b0 con 0x7f8f9c1abb40 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa37e1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c1b2bd0 con 0x7f8f9c1abf90 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8f9bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8f9bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56010/0 (socket says 172.21.15.73:56010) 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8f9b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 0x7f8f9c1b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8f9bfff700 1 -- 172.21.15.73:0/2980896174 learned_addr learned my addr 172.21.15.73:0/2980896174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.567 7f8fa0ddd700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f9c1abf90 0x7f8f9c1b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 -- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f9c1abf90 msgr2=0x7f8f9c1b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f9c1abf90 0x7f8f9c1b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 -- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 msgr2=0x7f8f9c1b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 0x7f8f9c1b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 -- 172.21.15.73:0/2980896174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c1b2e00 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9b7fe700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 0x7f8f9c1b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f9bfff700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8f9c0c5c90 tx=0x7f8f8c00ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:21.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f9c1b2e00 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00ee40 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c1b96e0 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f8c00f040 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c1b9ac0 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.568 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8f8c011070 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.569 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3078+0+0 (secure 0 0 0) 0x7f8f8c010040 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.569 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c0f08e0 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.572 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8f8c00c540 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.707 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f9c1ac690 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.716 7f8f997fa700 1 -- 172.21.15.73:0/2980896174 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f8c000c30 con 0x7f8f9c0cdec0 2024-03-24T10:39:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.722 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 >> v1:172.21.15.73:6816/43277 conn(0x7f8f7c0145b0 legacy=0x7f8f7c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.722 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 msgr2=0x7f8f9c1ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.722 7f8fa37e1700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8f9c0c5c90 tx=0x7f8f8c00ed00).stop 2024-03-24T10:39:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.724 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 shutdown_connections 2024-03-24T10:39:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.724 7f8fa37e1700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8f9c1abf90 0x7f8f9c1b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.724 7f8fa37e1700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f9c0cdec0 0x7f8f9c1ab510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.724 7f8fa37e1700 1 --2- 172.21.15.73:0/2980896174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f9c1abb40 0x7f8f9c1b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.724 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 >> 172.21.15.73:0/2980896174 conn(0x7f8f9c0e10c0 msgr2=0x7f8f9c0dade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:21.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.727 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 shutdown_connections 2024-03-24T10:39:21.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.728 7f8fa37e1700 1 -- 172.21.15.73:0/2980896174 wait complete. 2024-03-24T10:39:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-03-24T10:39:21.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:21.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.876 7f290032a700 1 Processor -- start 2024-03-24T10:39:21.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.876 7f290032a700 1 -- start start 2024-03-24T10:39:21.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 0x7f28f810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 0x7f28f819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f81a0a70 con 0x7f28f810bb90 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80fa590 con 0x7f28f810b740 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81a0c90 con 0x7f28f80f5a10 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 0x7f28f810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd926700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28f810bb90 0x7f28f81a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36340/0 (socket says 172.21.15.73:36340) 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd926700 1 -- 172.21.15.73:0/2279498325 learned_addr learned my addr 172.21.15.73:0/2279498325 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fc924700 1 --2- 172.21.15.73:0/2279498325 >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 0x7f28f819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 -- 172.21.15.73:0/2279498325 >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 msgr2=0x7f28f819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 --2- 172.21.15.73:0/2279498325 >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 0x7f28f819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 -- 172.21.15.73:0/2279498325 >> v1:172.21.15.73:6789/0 conn(0x7f28f810bb90 legacy=0x7f28f81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 -- 172.21.15.73:0/2279498325 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f81a93d0 con 0x7f28f80f5a10 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fc924700 1 --2- 172.21.15.73:0/2279498325 >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 0x7f28f819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:21.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28fd125700 1 --2- 172.21.15.73:0/2279498325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 0x7f28f810b110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f28e8002f70 tx=0x7f28e800b970).ready entity=mon.1 client_cookie=81ca3a958071c064 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28e7fff700 1 -- 172.21.15.73:0/2279498325 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28f81a93d0 con 0x7f28f80f5a10 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28e7fff700 1 -- 172.21.15.73:0/2279498325 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800d5c0 con 0x7f28f80f5a10 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f28e7fff700 1 -- 172.21.15.73:0/2279498325 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28e800d990 con 0x7f28f80f5a10 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 -- 172.21.15.73:0/2279498325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 msgr2=0x7f28f810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.877 7f290032a700 1 --2- 172.21.15.73:0/2279498325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 0x7f28f810b110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f28e8002f70 tx=0x7f28e800b970).stop 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 -- 172.21.15.73:0/2279498325 shutdown_connections 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 --2- 172.21.15.73:0/2279498325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f80f5a10 0x7f28f810b110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 --2- 172.21.15.73:0/2279498325 >> v2:172.21.15.73:3300/0 conn(0x7f28f810b740 0x7f28f819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 -- 172.21.15.73:0/2279498325 >> 172.21.15.73:0/2279498325 conn(0x7f28f8113a70 msgr2=0x7f28f80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 -- 172.21.15.73:0/2279498325 shutdown_connections 2024-03-24T10:39:21.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.878 7f290032a700 1 -- 172.21.15.73:0/2279498325 wait complete. 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.900 7f290032a700 1 Processor -- start 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.900 7f290032a700 1 -- start start 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28f80da720 0x7f28f81b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80bb820 con 0x7f28f80d9ca0 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80d9050 con 0x7f28f81b2e80 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f290032a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80c9280 con 0x7f28f80da720 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd926700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56038/0 (socket says 172.21.15.73:56038) 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fc924700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28f80da720 0x7f28f81b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:21.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd926700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46558/0 (socket says 172.21.15.73:46558) 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 -- 172.21.15.73:0/1607628479 learned_addr learned my addr 172.21.15.73:0/1607628479 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 -- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28f80da720 msgr2=0x7f28f81b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28f80da720 0x7f28f81b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 -- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 msgr2=0x7f28f81b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 -- 172.21.15.73:0/1607628479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80d98f0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd926700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28fd125700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f28e8002f70 tx=0x7f28e80068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.901 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28f80d98f0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.902 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8011a00 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.902 7f290032a700 1 -- 172.21.15.73:0/1607628479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f81b9de0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.902 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28e8017040 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.902 7f290032a700 1 -- 172.21.15.73:0/1607628479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81ba1c0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.903 7f290032a700 1 -- 172.21.15.73:0/1607628479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f80f08e0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.903 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f28e80273b0 con 0x7f28f80d9ca0 2024-03-24T10:39:21.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.903 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f28e8018070 con 0x7f28f80d9ca0 2024-03-24T10:39:21.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:21.906 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f28e80117f0 con 0x7f28f80d9ca0 2024-03-24T10:39:22.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.012 7f290032a700 1 -- 172.21.15.73:0/1607628479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f80e2430 con 0x7f28f80d9ca0 2024-03-24T10:39:22.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.013 7f28e67fc700 1 -- 172.21.15.73:0/1607628479 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8742 (secure 0 0 0) 0x7f28e800d3b0 con 0x7f28f80d9ca0 2024-03-24T10:39:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:22.013 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:21.708173","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 >> v1:172.21.15.73:6816/43277 conn(0x7f28d80145b0 legacy=0x7f28d8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 msgr2=0x7f28f80da0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f28e8002f70 tx=0x7f28e80068c0).stop 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 shutdown_connections 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f81b2e80 0x7f28f81b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f80d9ca0 0x7f28f80da0f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 --2- 172.21.15.73:0/1607628479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28f80da720 0x7f28f81b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 >> 172.21.15.73:0/1607628479 conn(0x7f28f80bc870 msgr2=0x7f28f80be240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 shutdown_connections 2024-03-24T10:39:22.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.014 7f290032a700 1 -- 172.21.15.73:0/1607628479 wait complete. 2024-03-24T10:39:22.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.150 7ff37c61c700 1 Processor -- start 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 -- start start 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff37410bb90 0x7ff3741a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3741a0a70 con 0x7ff37410b740 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740fa590 con 0x7ff37410bb90 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff37c61c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741a0c90 con 0x7ff3740f5a10 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379417700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379c18700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff37410bb90 0x7ff3741a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379417700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46216/0 (socket says 172.21.15.73:46216) 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379417700 1 -- 172.21.15.73:0/896664715 learned_addr learned my addr 172.21.15.73:0/896664715 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379c18700 1 -- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 msgr2=0x7ff37410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379c18700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379c18700 1 -- 172.21.15.73:0/896664715 >> v1:172.21.15.73:6789/0 conn(0x7ff37410b740 legacy=0x7ff37419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379c18700 1 -- 172.21.15.73:0/896664715 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3741a93d0 con 0x7ff37410bb90 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff363fff700 1 -- 172.21.15.73:0/896664715 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103495456 0 0) 0x7ff370001110 con 0x7ff37410b740 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.151 7ff379417700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff379c18700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37410bb90 0x7ff3741a0440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c009d10).ready entity=mon.0 client_cookie=56c4afbc3ac9a197 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff363fff700 1 -- 172.21.15.73:0/896664715 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3741a93d0 con 0x7ff37410bb90 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff363fff700 1 -- 172.21.15.73:0/896664715 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00b800 con 0x7ff37410bb90 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff363fff700 1 -- 172.21.15.73:0/896664715 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff36c00b9e0 con 0x7ff37410bb90 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 -- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37410bb90 msgr2=0x7ff3741a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37410bb90 0x7ff3741a0440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c009d10).stop 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 -- 172.21.15.73:0/896664715 shutdown_connections 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740f5a10 0x7ff37410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 --2- 172.21.15.73:0/896664715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37410bb90 0x7ff3741a0440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 -- 172.21.15.73:0/896664715 >> 172.21.15.73:0/896664715 conn(0x7ff374113a70 msgr2=0x7ff3740f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 -- 172.21.15.73:0/896664715 shutdown_connections 2024-03-24T10:39:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.152 7ff37c61c700 1 -- 172.21.15.73:0/896664715 wait complete. 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 Processor -- start 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 -- start start 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3741a1660 0x7ff3740d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 0x7ff3741b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740e6530 con 0x7ff3740d5d20 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740d9db0 con 0x7ff3741a1660 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff37c61c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741b0b40 con 0x7ff3740d58d0 2024-03-24T10:39:22.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff378c16700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff379c18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 0x7ff3741b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff378c16700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46228/0 (socket says 172.21.15.73:46228) 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff378c16700 1 -- 172.21.15.73:0/1217266964 learned_addr learned my addr 172.21.15.73:0/1217266964 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.175 7ff379417700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3741a1660 0x7ff3740d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 -- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 msgr2=0x7ff3741afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 -- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3741a1660 msgr2=0x7ff3740d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3741a1660 0x7ff3740d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 -- 172.21.15.73:0/1217266964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3741b0d70 con 0x7ff3740d5d20 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff378c16700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff379c18700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 0x7ff3741b0510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff3740e1440 tx=0x7ff36c006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3741b0d70 con 0x7ff3740d5d20 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c011b60 con 0x7ff3740d5d20 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff36c017040 con 0x7ff3740d5d20 2024-03-24T10:39:22.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3741b75d0 con 0x7ff3740d5d20 2024-03-24T10:39:22.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.176 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3741b79b0 con 0x7ff3740d5d20 2024-03-24T10:39:22.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.177 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff36c01c470 con 0x7ff3740d5d20 2024-03-24T10:39:22.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.177 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff36c018030 con 0x7ff3740d5d20 2024-03-24T10:39:22.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.177 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3740f08e0 con 0x7ff3740d5d20 2024-03-24T10:39:22.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.181 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff36c011950 con 0x7ff3740d5d20 2024-03-24T10:39:22.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.285 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3740e2430 con 0x7ff3740d5d20 2024-03-24T10:39:22.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.286 7ff3627fc700 1 -- 172.21.15.73:0/1217266964 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8742 (secure 0 0 0) 0x7ff36c00b5f0 con 0x7ff3740d5d20 2024-03-24T10:39:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:22.286 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:21.708173","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 >> v1:172.21.15.73:6816/43277 conn(0x7ff3540145b0 legacy=0x7ff354016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 msgr2=0x7ff3741b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 0x7ff3741b0510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff3740e1440 tx=0x7ff36c006c40).stop 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 shutdown_connections 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3740d5d20 0x7ff3741b0510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3741a1660 0x7ff3740d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 --2- 172.21.15.73:0/1217266964 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3740d58d0 0x7ff3741afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 >> 172.21.15.73:0/1217266964 conn(0x7ff3740e0340 msgr2=0x7ff3740c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 shutdown_connections 2024-03-24T10:39:22.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.287 7ff37c61c700 1 -- 172.21.15.73:0/1217266964 wait complete. 2024-03-24T10:39:22.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-24T10:39:22.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.428 7fa039a73700 1 Processor -- start 2024-03-24T10:39:22.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.428 7fa039a73700 1 -- start start 2024-03-24T10:39:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa039a73700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 0x7fa0341a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa039a73700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 0x7fa0341ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa039a73700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340f9230 con 0x7fa0340f5920 2024-03-24T10:39:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa039a73700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0340f24e0 con 0x7fa0340f2090 2024-03-24T10:39:22.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa039a73700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341ac720 con 0x7fa0341a8c80 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa03285d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa0340f5920 0x7fa0340f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36354/0 (socket says 172.21.15.73:36354) 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa03285d700 1 -- 172.21.15.73:0/1894228713 learned_addr learned my addr 172.21.15.73:0/1894228713 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa03305e700 1 --2- 172.21.15.73:0/1894228713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 0x7fa0341ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.429 7fa03205c700 1 --2- 172.21.15.73:0/1894228713 >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 0x7fa0341a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03185b700 1 -- 172.21.15.73:0/1894228713 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669114394 0 0) 0x7fa024001110 con 0x7fa0340f5920 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03185b700 1 -- 172.21.15.73:0/1894228713 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa018003270 con 0x7fa0340f5920 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03305e700 1 -- 172.21.15.73:0/1894228713 >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 msgr2=0x7fa0341a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03305e700 1 --2- 172.21.15.73:0/1894228713 >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 0x7fa0341a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03305e700 1 -- 172.21.15.73:0/1894228713 >> v1:172.21.15.73:6789/0 conn(0x7fa0340f5920 legacy=0x7fa0340f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03305e700 1 -- 172.21.15.73:0/1894228713 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0341ac8d0 con 0x7fa0341a8c80 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03205c700 1 --2- 172.21.15.73:0/1894228713 >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 0x7fa0341a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03305e700 1 --2- 172.21.15.73:0/1894228713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 0x7fa0341ab0e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa02c0032f0 tx=0x7fa02c009c90).ready entity=mon.1 client_cookie=7c91273f490c9ee0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03185b700 1 -- 172.21.15.73:0/1894228713 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0341ac8d0 con 0x7fa0341a8c80 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03185b700 1 -- 172.21.15.73:0/1894228713 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00b880 con 0x7fa0341a8c80 2024-03-24T10:39:22.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa03185b700 1 -- 172.21.15.73:0/1894228713 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa02c00ba60 con 0x7fa0341a8c80 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa039a73700 1 -- 172.21.15.73:0/1894228713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 msgr2=0x7fa0341ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.430 7fa039a73700 1 --2- 172.21.15.73:0/1894228713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 0x7fa0341ab0e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa02c0032f0 tx=0x7fa02c009c90).stop 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 -- 172.21.15.73:0/1894228713 shutdown_connections 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 --2- 172.21.15.73:0/1894228713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0341a8c80 0x7fa0341ab0e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 --2- 172.21.15.73:0/1894228713 >> v2:172.21.15.73:3300/0 conn(0x7fa0340f2090 0x7fa0341a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 -- 172.21.15.73:0/1894228713 >> 172.21.15.73:0/1894228713 conn(0x7fa034113a70 msgr2=0x7fa0340f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 -- 172.21.15.73:0/1894228713 shutdown_connections 2024-03-24T10:39:22.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.431 7fa039a73700 1 -- 172.21.15.73:0/1894228713 wait complete. 2024-03-24T10:39:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.453 7fa039a73700 1 Processor -- start 2024-03-24T10:39:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.453 7fa039a73700 1 -- start start 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa0340d2210 0x7fa0340c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 0x7fa0340c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340bc2c0 con 0x7fa0340c3aa0 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340d5880 con 0x7fa0340d1790 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340d5ad0 con 0x7fa0340d2210 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03205c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa0340d2210 0x7fa0340c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46582/0 (socket says 172.21.15.73:46582) 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 -- 172.21.15.73:0/1832913890 learned_addr learned my addr 172.21.15.73:0/1832913890 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03305e700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 0x7fa0340c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 -- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa0340d2210 msgr2=0x7fa0340c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa0340d2210 0x7fa0340c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 -- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 msgr2=0x7fa0340c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 0x7fa0340c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 -- 172.21.15.73:0/1832913890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340d7c60 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03305e700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 0x7fa0340c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa03285d700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa0341b4260 tx=0x7fa02400c810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0340d7c60 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0240072e0 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa024005810 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.454 7fa039a73700 1 -- 172.21.15.73:0/1832913890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0341bb900 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.455 7fa039a73700 1 -- 172.21.15.73:0/1832913890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0341bbce0 con 0x7fa0340d1790 2024-03-24T10:39:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.455 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa024005a10 con 0x7fa0340d1790 2024-03-24T10:39:22.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.455 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa0240149e0 con 0x7fa0340d1790 2024-03-24T10:39:22.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.455 7fa039a73700 1 -- 172.21.15.73:0/1832913890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0340f08e0 con 0x7fa0340d1790 2024-03-24T10:39:22.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.459 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa0240070d0 con 0x7fa0340d1790 2024-03-24T10:39:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.596 7fa039a73700 1 -- 172.21.15.73:0/1832913890 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa0341ae970 con 0x7fa0340d1790 2024-03-24T10:39:22.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.713 7fa023fff700 1 -- 172.21.15.73:0/1832913890 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa0340fefc0 con 0x7fa0340d1790 2024-03-24T10:39:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.715 7fa039a73700 1 -- 172.21.15.73:0/1832913890 >> v1:172.21.15.73:6816/43277 conn(0x7fa0100145b0 legacy=0x7fa010016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.715 7fa039a73700 1 -- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 msgr2=0x7fa0340d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.715 7fa039a73700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa0341b4260 tx=0x7fa02400c810).stop 2024-03-24T10:39:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 -- 172.21.15.73:0/1832913890 shutdown_connections 2024-03-24T10:39:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0340c3aa0 0x7fa0340c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0340d1790 0x7fa0340d1be0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 --2- 172.21.15.73:0/1832913890 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa0340d2210 0x7fa0340c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 -- 172.21.15.73:0/1832913890 >> 172.21.15.73:0/1832913890 conn(0x7fa0340dc370 msgr2=0x7fa0340c0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.716 7fa039a73700 1 -- 172.21.15.73:0/1832913890 shutdown_connections 2024-03-24T10:39:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.718 7fa039a73700 1 -- 172.21.15.73:0/1832913890 wait complete. 2024-03-24T10:39:22.729 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-24T10:39:22.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-24T10:39:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 Processor -- start 2024-03-24T10:39:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 -- start start 2024-03-24T10:39:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 0x7ffab01a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 0x7ffab01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab010bd60 con 0x7ffab00f5a10 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00fa590 con 0x7ffab01a59d0 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffab6f9e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01a0c50 con 0x7ffab010b910 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffaaffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 0x7ffab01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffaaeffd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 0x7ffab01a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffaaf7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffab00f5a10 0x7ffab010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36370/0 (socket says 172.21.15.73:36370) 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.857 7ffaaf7fe700 1 -- 172.21.15.73:0/4272528388 learned_addr learned my addr 172.21.15.73:0/4272528388 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaeffd700 1 -- 172.21.15.73:0/4272528388 >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 msgr2=0x7ffab01a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaeffd700 1 --2- 172.21.15.73:0/4272528388 >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 0x7ffab01a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaeffd700 1 -- 172.21.15.73:0/4272528388 >> v1:172.21.15.73:6789/0 conn(0x7ffab00f5a10 legacy=0x7ffab010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaae7fc700 1 -- 172.21.15.73:0/4272528388 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127469712 0 0) 0x7ffa98001110 con 0x7ffab00f5a10 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaeffd700 1 -- 172.21.15.73:0/4272528388 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab01a9470 con 0x7ffab010b910 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaffff700 1 --2- 172.21.15.73:0/4272528388 >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 0x7ffab01a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaaeffd700 1 --2- 172.21.15.73:0/4272528388 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 0x7ffab01a53a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffab0103a10 tx=0x7ffaa000b9a0).ready entity=mon.2 client_cookie=f44f5934b999b50f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaae7fc700 1 -- 172.21.15.73:0/4272528388 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffab01a9470 con 0x7ffab010b910 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaae7fc700 1 -- 172.21.15.73:0/4272528388 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000d5c0 con 0x7ffab010b910 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffaae7fc700 1 -- 172.21.15.73:0/4272528388 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaa000d990 con 0x7ffab010b910 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffab6f9e700 1 -- 172.21.15.73:0/4272528388 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 msgr2=0x7ffab01a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.858 7ffab6f9e700 1 --2- 172.21.15.73:0/4272528388 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 0x7ffab01a53a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffab0103a10 tx=0x7ffaa000b9a0).stop 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 -- 172.21.15.73:0/4272528388 shutdown_connections 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 --2- 172.21.15.73:0/4272528388 >> v2:172.21.15.73:3300/0 conn(0x7ffab01a59d0 0x7ffab01a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 --2- 172.21.15.73:0/4272528388 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab010b910 0x7ffab01a53a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 -- 172.21.15.73:0/4272528388 >> 172.21.15.73:0/4272528388 conn(0x7ffab0113a70 msgr2=0x7ffab00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 -- 172.21.15.73:0/4272528388 shutdown_connections 2024-03-24T10:39:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.859 7ffab6f9e700 1 -- 172.21.15.73:0/4272528388 wait complete. 2024-03-24T10:39:22.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.881 7ffab6f9e700 1 Processor -- start 2024-03-24T10:39:22.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 -- start start 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 0x7ffab01b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c4ee0 con 0x7ffab01af140 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00d48e0 con 0x7ffab01ae6c0 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffab6f9e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c4240 con 0x7ffab01b1df0 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 0x7ffab01b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46248/0 (socket says 172.21.15.73:46248) 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaffff700 1 -- 172.21.15.73:0/103766613 learned_addr learned my addr 172.21.15.73:0/103766613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:22.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46596/0 (socket says 172.21.15.73:46596) 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 -- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 msgr2=0x7ffab01b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 -- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 msgr2=0x7ffab01aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaeffd700 1 -- 172.21.15.73:0/103766613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab01b8e50 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaf7fe700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.882 7ffaaffff700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaaeffd700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 0x7ffab01b17c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ffab00d72c0 tx=0x7ffaa00068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffab01b8e50 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa001a4e0 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab00f1890 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaa0020070 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00f1d30 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ffaa001a8b0 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.883 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ffaa00096b0 con 0x7ffab01af140 2024-03-24T10:39:22.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.884 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00f08e0 con 0x7ffab01af140 2024-03-24T10:39:22.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:22.887 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ffaa001a1e0 con 0x7ffab01af140 2024-03-24T10:39:23.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.024 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffab01a39d0 con 0x7ffab01af140 2024-03-24T10:39:23.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.719 7ffaacff9700 1 -- 172.21.15.73:0/103766613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffaa000d3b0 con 0x7ffab01af140 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.721 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 >> v1:172.21.15.73:6816/43277 conn(0x7ffa940145b0 legacy=0x7ffa94016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.721 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 msgr2=0x7ffab01b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.721 7ffab6f9e700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 0x7ffab01b17c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ffab00d72c0 tx=0x7ffaa00068c0).stop 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 shutdown_connections 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffab01b1df0 0x7ffab01b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffab01ae6c0 0x7ffab01aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 --2- 172.21.15.73:0/103766613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffab01af140 0x7ffab01b17c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 >> 172.21.15.73:0/103766613 conn(0x7ffab01a4b30 msgr2=0x7ffab00d75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:23.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 shutdown_connections 2024-03-24T10:39:23.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.722 7ffab6f9e700 1 -- 172.21.15.73:0/103766613 wait complete. 2024-03-24T10:39:23.734 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-24T10:39:23.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 Processor -- start 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 -- start start 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54f00f58a0 0x7f54f00f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 0x7f54f010e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00f91b0 con 0x7f54f00f2290 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f010f060 con 0x7f54f00f58a0 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54f6df4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f01ac600 con 0x7f54f00f1e40 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 0x7f54f010e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54ef7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54f00f58a0 0x7f54f00f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:23.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54effff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54f00f2290 0x7f54f010e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36382/0 (socket says 172.21.15.73:36382) 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54effff700 1 -- 172.21.15.73:0/3321694985 learned_addr learned my addr 172.21.15.73:0/3321694985 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 -- 172.21.15.73:0/3321694985 >> v2:172.21.15.73:3300/0 conn(0x7f54f00f58a0 msgr2=0x7f54f00f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 --2- 172.21.15.73:0/3321694985 >> v2:172.21.15.73:3300/0 conn(0x7f54f00f58a0 0x7f54f00f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 -- 172.21.15.73:0/3321694985 >> v1:172.21.15.73:6789/0 conn(0x7f54f00f2290 legacy=0x7f54f010e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 -- 172.21.15.73:0/3321694985 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f01ac7b0 con 0x7f54f00f1e40 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.862 7f54eeffd700 1 --2- 172.21.15.73:0/3321694985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 0x7f54f010e230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f54e0002f70 tx=0x7f54e000b970).ready entity=mon.1 client_cookie=ddfdac0afa60d060 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54ee7fc700 1 -- 172.21.15.73:0/3321694985 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54f01ac7b0 con 0x7f54f00f1e40 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54ee7fc700 1 -- 172.21.15.73:0/3321694985 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e000d610 con 0x7f54f00f1e40 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54ee7fc700 1 -- 172.21.15.73:0/3321694985 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54e000d9e0 con 0x7f54f00f1e40 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 -- 172.21.15.73:0/3321694985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 msgr2=0x7f54f010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 --2- 172.21.15.73:0/3321694985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 0x7f54f010e230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f54e0002f70 tx=0x7f54e000b970).stop 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 -- 172.21.15.73:0/3321694985 shutdown_connections 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 --2- 172.21.15.73:0/3321694985 >> v2:172.21.15.73:3300/0 conn(0x7f54f00f58a0 0x7f54f00f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 --2- 172.21.15.73:0/3321694985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00f1e40 0x7f54f010e230 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 -- 172.21.15.73:0/3321694985 >> 172.21.15.73:0/3321694985 conn(0x7f54f01139f0 msgr2=0x7f54f00f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:23.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 -- 172.21.15.73:0/3321694985 shutdown_connections 2024-03-24T10:39:23.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.863 7f54f6df4700 1 -- 172.21.15.73:0/3321694985 wait complete. 2024-03-24T10:39:23.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 Processor -- start 2024-03-24T10:39:23.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 -- start start 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 0x7f54f00cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 0x7f54f00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00effc0 con 0x7f54f00c51b0 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00ce810 con 0x7f54f00cbe40 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.886 7f54f6df4700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00cd240 con 0x7f54f00cb9f0 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54effff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 0x7f54f00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56098/0 (socket says 172.21.15.73:56098) 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 -- 172.21.15.73:0/2330693668 learned_addr learned my addr 172.21.15.73:0/2330693668 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54eeffd700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 0x7f54f00cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 -- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 msgr2=0x7f54f00cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 0x7f54f00cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 -- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 msgr2=0x7f54f00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 0x7f54f00ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 -- 172.21.15.73:0/2330693668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00cd440 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54effff700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 0x7f54f00ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54eeffd700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 0x7f54f00cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ef7fe700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f54d800c000 tx=0x7f54d800eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54f00cd440 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d800c9a0 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f01bba50 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54d800f040 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.887 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f01bbe30 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.888 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f54d8011070 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.888 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f54d8010040 con 0x7f54f00c51b0 2024-03-24T10:39:23.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.888 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f00bc480 con 0x7f54f00c51b0 2024-03-24T10:39:23.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:23.891 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f54d800c5a0 con 0x7f54f00c51b0 2024-03-24T10:39:24.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.026 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54f00f0860 con 0x7f54f00c51b0 2024-03-24T10:39:24.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.026 7f54ecff9700 1 -- 172.21.15.73:0/2330693668 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f54d8000c30 con 0x7f54f00c51b0 2024-03-24T10:39:24.026 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:24.027 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:24.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 >> v1:172.21.15.73:6816/43277 conn(0x7f54d40145b0 legacy=0x7f54d4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 msgr2=0x7f54f00cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f54d800c000 tx=0x7f54d800eca0).stop 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 shutdown_connections 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54f00cbe40 0x7f54f00ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54f00c51b0 0x7f54f00cb3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 --2- 172.21.15.73:0/2330693668 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54f00cb9f0 0x7f54f00cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 >> 172.21.15.73:0/2330693668 conn(0x7f54f00c5d00 msgr2=0x7f54f00bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 shutdown_connections 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.027 7f54f6df4700 1 -- 172.21.15.73:0/2330693668 wait complete. 2024-03-24T10:39:24.028 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:24.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:24.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.164 7fc7ec577700 1 Processor -- start 2024-03-24T10:39:24.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.164 7fc7ec577700 1 -- start start 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7ec577700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 0x7fc7e41a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7ec577700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 0x7fc7e41a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7ec577700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e410bd60 con 0x7fc7e40f5a10 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7ec577700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e40fa590 con 0x7fc7e410b910 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7ec577700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41a0c50 con 0x7fc7e41a59d0 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9372700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7e40f5a10 0x7fc7e410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36384/0 (socket says 172.21.15.73:36384) 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9372700 1 -- 172.21.15.73:0/3002737686 learned_addr learned my addr 172.21.15.73:0/3002737686 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9b73700 1 --2- 172.21.15.73:0/3002737686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 0x7fc7e41a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e8b71700 1 --2- 172.21.15.73:0/3002737686 >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 0x7fc7e41a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7d3fff700 1 -- 172.21.15.73:0/3002737686 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947018697 0 0) 0x7fc7dc001490 con 0x7fc7e40f5a10 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7d3fff700 1 -- 172.21.15.73:0/3002737686 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc003270 con 0x7fc7e40f5a10 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9b73700 1 -- 172.21.15.73:0/3002737686 >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 msgr2=0x7fc7e41a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9b73700 1 --2- 172.21.15.73:0/3002737686 >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 0x7fc7e41a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9b73700 1 -- 172.21.15.73:0/3002737686 >> v1:172.21.15.73:6789/0 conn(0x7fc7e40f5a10 legacy=0x7fc7e410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.165 7fc7e9b73700 1 -- 172.21.15.73:0/3002737686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e41a9470 con 0x7fc7e41a59d0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7e8b71700 1 --2- 172.21.15.73:0/3002737686 >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 0x7fc7e41a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7e9b73700 1 --2- 172.21.15.73:0/3002737686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 0x7fc7e41a7e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc7e40f47c0 tx=0x7fc7e000dc00).ready entity=mon.1 client_cookie=7badf51c44b836d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7d3fff700 1 -- 172.21.15.73:0/3002737686 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7e41a9470 con 0x7fc7e41a59d0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7d3fff700 1 -- 172.21.15.73:0/3002737686 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e000bc20 con 0x7fc7e41a59d0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7d3fff700 1 -- 172.21.15.73:0/3002737686 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7e0015070 con 0x7fc7e41a59d0 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 -- 172.21.15.73:0/3002737686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 msgr2=0x7fc7e41a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 --2- 172.21.15.73:0/3002737686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 0x7fc7e41a7e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc7e40f47c0 tx=0x7fc7e000dc00).stop 2024-03-24T10:39:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 -- 172.21.15.73:0/3002737686 shutdown_connections 2024-03-24T10:39:24.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 --2- 172.21.15.73:0/3002737686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e41a59d0 0x7fc7e41a7e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 --2- 172.21.15.73:0/3002737686 >> v2:172.21.15.73:3300/0 conn(0x7fc7e410b910 0x7fc7e41a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 -- 172.21.15.73:0/3002737686 >> 172.21.15.73:0/3002737686 conn(0x7fc7e4113a70 msgr2=0x7fc7e40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 -- 172.21.15.73:0/3002737686 shutdown_connections 2024-03-24T10:39:24.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.166 7fc7ec577700 1 -- 172.21.15.73:0/3002737686 wait complete. 2024-03-24T10:39:24.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.189 7fc7ec577700 1 Processor -- start 2024-03-24T10:39:24.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.189 7fc7ec577700 1 -- start start 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.189 7fc7ec577700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7e40cea20 0x7fc7e41b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 0x7fc7e41b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40e6530 con 0x7fc7e40d3c60 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40c3bd0 con 0x7fc7e40cee70 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41b5350 con 0x7fc7e40cea20 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9372700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e8b71700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7e40cea20 0x7fc7e41b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9372700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56126/0 (socket says 172.21.15.73:56126) 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9372700 1 -- 172.21.15.73:0/2975424436 learned_addr learned my addr 172.21.15.73:0/2975424436 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 0x7fc7e41b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 -- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7e40cea20 msgr2=0x7fc7e41b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7e40cea20 0x7fc7e41b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 -- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 msgr2=0x7fc7e40ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 -- 172.21.15.73:0/2975424436 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e41b5580 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9372700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7e9b73700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 0x7fc7e41b4d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc7e41a5530 tx=0x7fc7e00068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7e41b5580 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e001a440 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e41bbde0 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.190 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7e001a810 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.191 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e41bc1c0 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.191 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc7e001aa10 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.191 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc7e0015d60 con 0x7fc7e40cee70 2024-03-24T10:39:24.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.191 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e40f08e0 con 0x7fc7e40cee70 2024-03-24T10:39:24.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.195 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc7e0010af0 con 0x7fc7e40cee70 2024-03-24T10:39:24.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.300 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e40e2430 con 0x7fc7e40cee70 2024-03-24T10:39:24.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.301 7fc7d27fc700 1 -- 172.21.15.73:0/2975424436 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7fc7e000b820 con 0x7fc7e40cee70 2024-03-24T10:39:24.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:24.301 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 >> v1:172.21.15.73:6816/43277 conn(0x7fc7c40145b0 legacy=0x7fc7c4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 msgr2=0x7fc7e41b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 0x7fc7e41b4d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc7e41a5530 tx=0x7fc7e00068c0).stop 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 shutdown_connections 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7e40cee70 0x7fc7e41b4d20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7e40d3c60 0x7fc7e40ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 --2- 172.21.15.73:0/2975424436 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7e40cea20 0x7fc7e41b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.302 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 >> 172.21.15.73:0/2975424436 conn(0x7fc7e40e0680 msgr2=0x7fc7e41a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.303 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 shutdown_connections 2024-03-24T10:39:24.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.303 7fc7ec577700 1 -- 172.21.15.73:0/2975424436 wait complete. 2024-03-24T10:39:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-24T10:39:24.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 Processor -- start 2024-03-24T10:39:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 -- start start 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 0x7f93f410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f40f9230 con 0x7f93f40f5920 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f410ef10 con 0x7f93f40f2310 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93faa95700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41aa660 con 0x7f93f40f1ec0 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f37fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f37fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56140/0 (socket says 172.21.15.73:56140) 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f37fe700 1 -- 172.21.15.73:0/404730015 learned_addr learned my addr 172.21.15.73:0/404730015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46648/0 (socket says 172.21.15.73:46648) 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.440 7f93f2ffd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 0x7f93f410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 -- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 msgr2=0x7f93f410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 0x7f93f410e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 -- 172.21.15.73:0/404730015 >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 msgr2=0x7f93f40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 --2- 172.21.15.73:0/404730015 >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 -- 172.21.15.73:0/404730015 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f41aa810 con 0x7f93f40f2310 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f37fe700 1 --2- 172.21.15.73:0/404730015 >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f2ffd700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 0x7f93f410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f3fff700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f93f40f4640 tx=0x7f93ec009d40).ready entity=mon.1 client_cookie=d3a32c26acc5e034 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f27fc700 1 -- 172.21.15.73:0/404730015 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93f41aa810 con 0x7f93f40f2310 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f27fc700 1 -- 172.21.15.73:0/404730015 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00b7c0 con 0x7f93f40f2310 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93f27fc700 1 -- 172.21.15.73:0/404730015 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93ec00b9a0 con 0x7f93f40f2310 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93faa95700 1 -- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 msgr2=0x7f93f410e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.441 7f93faa95700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f93f40f4640 tx=0x7f93ec009d40).stop 2024-03-24T10:39:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 -- 172.21.15.73:0/404730015 shutdown_connections 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40f2310 0x7f93f410e8e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 --2- 172.21.15.73:0/404730015 >> v2:172.21.15.73:3300/0 conn(0x7f93f40f5920 0x7f93f40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 --2- 172.21.15.73:0/404730015 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40f1ec0 0x7f93f410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 -- 172.21.15.73:0/404730015 >> 172.21.15.73:0/404730015 conn(0x7f93f4113a70 msgr2=0x7f93f40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 -- 172.21.15.73:0/404730015 shutdown_connections 2024-03-24T10:39:24.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.442 7f93faa95700 1 -- 172.21.15.73:0/404730015 wait complete. 2024-03-24T10:39:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 Processor -- start 2024-03-24T10:39:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 -- start start 2024-03-24T10:39:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 0x7f93f40d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 0x7f93f41bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40d6a00 con 0x7f93f41b1cb0 2024-03-24T10:39:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40bea10 con 0x7f93f40d5e00 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93faa95700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40d6c40 con 0x7f93f40d5380 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 0x7f93f41bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 0x7f93f41bbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46658/0 (socket says 172.21.15.73:46658) 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56156/0 (socket says 172.21.15.73:56156) 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f3fff700 1 -- 172.21.15.73:0/839739340 learned_addr learned my addr 172.21.15.73:0/839739340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.465 7f93f2ffd700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 0x7f93f40d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 -- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 msgr2=0x7f93f41bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 0x7f93f41bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 -- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 msgr2=0x7f93f41b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 -- 172.21.15.73:0/839739340 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40d74e0 con 0x7f93f40d5380 2024-03-24T10:39:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f37fe700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f2ffd700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 0x7f93f40d57d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f93f40e0d80 tx=0x7f93e400eb40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93f40d74e0 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e400c7f0 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93faa95700 1 -- 172.21.15.73:0/839739340 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f41bc3e0 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93e400f040 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93faa95700 1 -- 172.21.15.73:0/839739340 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f41bc7c0 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.466 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f93e4011070 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.467 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f93e4010040 con 0x7f93f40d5380 2024-03-24T10:39:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.467 7f93faa95700 1 -- 172.21.15.73:0/839739340 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f40d8380 con 0x7f93f40d5380 2024-03-24T10:39:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.470 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f93e400c3f0 con 0x7f93f40d5380 2024-03-24T10:39:24.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.572 7f93faa95700 1 -- 172.21.15.73:0/839739340 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f93f4087810 con 0x7f93d40145b0 2024-03-24T10:39:24.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.580 7f93f0ff9700 1 -- 172.21.15.73:0/839739340 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299708 (unknown 2965378022 0 534465067) 0x7f93e8009980 con 0x7f93d40145b0 2024-03-24T10:39:24.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.582 7f93faa95700 1 -- 172.21.15.73:0/839739340 >> v1:172.21.15.73:6816/43277 conn(0x7f93d40145b0 legacy=0x7f93d4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.582 7f93faa95700 1 -- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 msgr2=0x7f93f40d57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.582 7f93faa95700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 0x7f93f40d57d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f93f40e0d80 tx=0x7f93e400eb40).stop 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 -- 172.21.15.73:0/839739340 shutdown_connections 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93f40d5e00 0x7f93f41bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93f41b1cb0 0x7f93f41b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 --2- 172.21.15.73:0/839739340 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f93f40d5380 0x7f93f40d57d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 -- 172.21.15.73:0/839739340 >> 172.21.15.73:0/839739340 conn(0x7f93f40deb80 msgr2=0x7f93f40e0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 -- 172.21.15.73:0/839739340 shutdown_connections 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.583 7f93faa95700 1 -- 172.21.15.73:0/839739340 wait complete. 2024-03-24T10:39:24.587 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:24.594 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-24 10:39:23.112092","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194752,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292608,"statfs":{"total":386547056640,"available":382251630592,"internally_reserved":4294967296,"allocated":425984,"data_stored":97524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.170729","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:13.170729","last_peered":"2024-03-24 10:39:13.170729","last_clean":"2024-03-24 10:39:13.170729","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:13.170729","last_undegraded":"2024-03-24 10:39:13.170729","last_fullsized":"2024-03-24 10:39:13.170729","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174491","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:13.174491","last_peered":"2024-03-24 10:39:13.174491","last_clean":"2024-03-24 10:39:13.174491","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:13.174491","last_undegraded":"2024-03-24 10:39:13.174491","last_fullsized":"2024-03-24 10:39:13.174491","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.172963","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:13.172963","last_peered":"2024-03-24 10:39:13.172963","last_clean":"2024-03-24 10:39:13.172963","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:13.172963","last_undegraded":"2024-03-24 10:39:13.172963","last_fullsized":"2024-03-24 10:39:13.172963","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174638","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:13.174638","last_peered":"2024-03-24 10:39:13.174638","last_clean":"2024-03-24 10:39:13.174638","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:13.174638","last_undegraded":"2024-03-24 10:39:13.174638","last_fullsized":"2024-03-24 10:39:13.174638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.173542","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:13.173542","last_peered":"2024-03-24 10:39:13.173542","last_clean":"2024-03-24 10:39:13.173542","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:13.173542","last_undegraded":"2024-03-24 10:39:13.173542","last_fullsized":"2024-03-24 10:39:13.173542","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174509","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:13.174509","last_peered":"2024-03-24 10:39:13.174509","last_clean":"2024-03-24 10:39:13.174509","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:13.174509","last_undegraded":"2024-03-24 10:39:13.174509","last_fullsized":"2024-03-24 10:39:13.174509","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.173842","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:13.173842","last_peered":"2024-03-24 10:39:13.173842","last_clean":"2024-03-24 10:39:13.173842","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:13.173842","last_undegraded":"2024-03-24 10:39:13.173842","last_fullsized":"2024-03-24 10:39:13.173842","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.172579","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:13.172579","last_peered":"2024-03-24 10:39:13.172579","last_clean":"2024-03-24 10:39:13.172579","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:13.172579","last_undegraded":"2024-03-24 10:39:13.172579","last_fullsized":"2024-03-24 10:39:13.172579","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]}]}]}} 2024-03-24T10:39:24.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.761 7f6ab007f700 1 Processor -- start 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.761 7f6ab007f700 1 -- start start 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 0x7f6aa810b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6aa810bb10 0x7f6aa81a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80fa510 con 0x7f6aa810bb10 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81a0820 con 0x7f6aa810b6c0 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81a0a50 con 0x7f6aa80f5990 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aace7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 0x7f6aa810b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6aa810bb10 0x7f6aa81a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46662/0 (socket says 172.21.15.73:46662) 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6aa810bb10 0x7f6aa81a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56166/0 (socket says 172.21.15.73:56166) 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aace7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 0x7f6aa810b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46284/0 (socket says 172.21.15.73:46284) 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa7fff700 1 -- 172.21.15.73:0/948067996 learned_addr learned my addr 172.21.15.73:0/948067996 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 -- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 msgr2=0x7f6aa810b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 0x7f6aa810b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 -- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 msgr2=0x7f6aa819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 -- 172.21.15.73:0/948067996 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa81a7330 con 0x7f6aa810bb10 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa7fff700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aad67b700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa810bb10 0x7f6aa81a01f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6a98002f70 tx=0x7f6a9800b9f0).ready entity=mon.0 client_cookie=35670e3cac140eb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa77fe700 1 -- 172.21.15.73:0/948067996 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6aa81a7330 con 0x7f6aa810bb10 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa77fe700 1 -- 172.21.15.73:0/948067996 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9800d570 con 0x7f6aa810bb10 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6aa77fe700 1 -- 172.21.15.73:0/948067996 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a9800d940 con 0x7f6aa810bb10 2024-03-24T10:39:24.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 -- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa810bb10 msgr2=0x7f6aa81a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.762 7f6ab007f700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa810bb10 0x7f6aa81a01f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6a98002f70 tx=0x7f6a9800b9f0).stop 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 -- 172.21.15.73:0/948067996 shutdown_connections 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa810bb10 0x7f6aa81a01f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80f5990 0x7f6aa810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 --2- 172.21.15.73:0/948067996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa810b6c0 0x7f6aa819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 -- 172.21.15.73:0/948067996 >> 172.21.15.73:0/948067996 conn(0x7f6aa81139f0 msgr2=0x7f6aa80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 -- 172.21.15.73:0/948067996 shutdown_connections 2024-03-24T10:39:24.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.763 7f6ab007f700 1 -- 172.21.15.73:0/948067996 wait complete. 2024-03-24T10:39:24.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.786 7f6ab007f700 1 Processor -- start 2024-03-24T10:39:24.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.786 7f6ab007f700 1 -- start start 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 0x7f6aa80d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa80d5820 0x7f6aa81afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 0x7f6aa81b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80ca2c0 con 0x7f6aa80d5820 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80ca4a0 con 0x7f6aa80d5c70 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81b0b30 con 0x7f6aa80c9c90 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aace7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 0x7f6aa80d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 0x7f6aa81b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aace7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 0x7f6aa80d51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46290/0 (socket says 172.21.15.73:46290) 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aace7a700 1 -- 172.21.15.73:0/1674890306 learned_addr learned my addr 172.21.15.73:0/1674890306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aa7fff700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa80d5820 0x7f6aa81afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 -- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 msgr2=0x7f6aa80d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 0x7f6aa80d51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 -- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa80d5820 msgr2=0x7f6aa81afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa80d5820 0x7f6aa81afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 -- 172.21.15.73:0/1674890306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa81b0d60 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aad67b700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 0x7f6aa81b0500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6a98002f70 tx=0x7f6a980068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6aa81b0d60 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98011610 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.787 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa81b75c0 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.788 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a98017040 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.788 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa81b79a0 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.788 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6a980119e0 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.788 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f6a98018070 con 0x7f6aa80d5c70 2024-03-24T10:39:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.789 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa80f0860 con 0x7f6aa80d5c70 2024-03-24T10:39:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.792 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f6a98011400 con 0x7f6aa80d5c70 2024-03-24T10:39:24.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.893 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f6aa8087810 con 0x7f6a8c0145b0 2024-03-24T10:39:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.900 7f6aa5ffb700 1 -- 172.21.15.73:0/1674890306 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299708 (unknown 2965378022 0 534465067) 0x7f6aa0009a90 con 0x7f6a8c0145b0 2024-03-24T10:39:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.902 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 >> v1:172.21.15.73:6816/43277 conn(0x7f6a8c0145b0 legacy=0x7f6a8c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.902 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 msgr2=0x7f6aa81b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.902 7f6ab007f700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 0x7f6aa81b0500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6a98002f70 tx=0x7f6a980068c0).stop 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 shutdown_connections 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6aa80d5c70 0x7f6aa81b0500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6aa80c9c90 0x7f6aa80d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 --2- 172.21.15.73:0/1674890306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aa80d5820 0x7f6aa81afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:24.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 >> 172.21.15.73:0/1674890306 conn(0x7f6aa80c7e50 msgr2=0x7f6aa80df990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:24.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 shutdown_connections 2024-03-24T10:39:24.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:24.903 7f6ab007f700 1 -- 172.21.15.73:0/1674890306 wait complete. 2024-03-24T10:39:24.907 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:24.913 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-24 10:39:23.112092","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194752,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292608,"statfs":{"total":386547056640,"available":382251630592,"internally_reserved":4294967296,"allocated":425984,"data_stored":97524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.170729","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:13.170729","last_peered":"2024-03-24 10:39:13.170729","last_clean":"2024-03-24 10:39:13.170729","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:13.170729","last_undegraded":"2024-03-24 10:39:13.170729","last_fullsized":"2024-03-24 10:39:13.170729","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174491","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:13.174491","last_peered":"2024-03-24 10:39:13.174491","last_clean":"2024-03-24 10:39:13.174491","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:13.174491","last_undegraded":"2024-03-24 10:39:13.174491","last_fullsized":"2024-03-24 10:39:13.174491","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.172963","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:13.172963","last_peered":"2024-03-24 10:39:13.172963","last_clean":"2024-03-24 10:39:13.172963","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:13.172963","last_undegraded":"2024-03-24 10:39:13.172963","last_fullsized":"2024-03-24 10:39:13.172963","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174638","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:13.174638","last_peered":"2024-03-24 10:39:13.174638","last_clean":"2024-03-24 10:39:13.174638","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:13.174638","last_undegraded":"2024-03-24 10:39:13.174638","last_fullsized":"2024-03-24 10:39:13.174638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.173542","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:13.173542","last_peered":"2024-03-24 10:39:13.173542","last_clean":"2024-03-24 10:39:13.173542","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:13.173542","last_undegraded":"2024-03-24 10:39:13.173542","last_fullsized":"2024-03-24 10:39:13.173542","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.174509","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:13.174509","last_peered":"2024-03-24 10:39:13.174509","last_clean":"2024-03-24 10:39:13.174509","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:13.174509","last_undegraded":"2024-03-24 10:39:13.174509","last_fullsized":"2024-03-24 10:39:13.174509","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.173842","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:13.173842","last_peered":"2024-03-24 10:39:13.173842","last_clean":"2024-03-24 10:39:13.173842","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:13.173842","last_undegraded":"2024-03-24 10:39:13.173842","last_fullsized":"2024-03-24 10:39:13.173842","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-03-24 10:39:13.172579","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:13.172579","last_peered":"2024-03-24 10:39:13.172579","last_clean":"2024-03-24 10:39:13.172579","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:13.172579","last_undegraded":"2024-03-24 10:39:13.172579","last_fullsized":"2024-03-24 10:39:13.172579","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:21.362909","last_change":"2024-03-24 10:39:21.362909","last_active":"2024-03-24 10:39:21.362909","last_peered":"2024-03-24 10:39:21.362909","last_clean":"2024-03-24 10:39:21.362909","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:21.362909","last_undegraded":"2024-03-24 10:39:21.362909","last_fullsized":"2024-03-24 10:39:21.362909","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:39:20.350551","last_change":"2024-03-24 10:39:20.350551","last_active":"2024-03-24 10:39:20.350551","last_peered":"2024-03-24 10:39:20.350551","last_clean":"2024-03-24 10:39:20.350551","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:39:20.350551","last_undegraded":"2024-03-24 10:39:20.350551","last_fullsized":"2024-03-24 10:39:20.350551","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]}]}]}} 2024-03-24T10:39:24.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.079 7f52a2ee1700 1 Processor -- start 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.079 7f52a2ee1700 1 -- start start 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f52a2ee1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 0x7f529c1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f52a2ee1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 0x7f529c1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f52a2ee1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c10bd60 con 0x7f529c0f5a10 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f52a2ee1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c0fa590 con 0x7f529c10b910 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f52a2ee1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1a0c50 con 0x7f529c1a59d0 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529affd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 0x7f529c1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 0x7f529c1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f529c0f5a10 0x7f529c10b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36388/0 (socket says 172.21.15.73:36388) 2024-03-24T10:39:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529b7fe700 1 -- 172.21.15.73:0/2233422773 learned_addr learned my addr 172.21.15.73:0/2233422773 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 -- 172.21.15.73:0/2233422773 >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 msgr2=0x7f529c1a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 --2- 172.21.15.73:0/2233422773 >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 0x7f529c1a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 -- 172.21.15.73:0/2233422773 >> v1:172.21.15.73:6789/0 conn(0x7f529c0f5a10 legacy=0x7f529c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529a7fc700 1 -- 172.21.15.73:0/2233422773 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440540248 0 0) 0x7f528c001490 con 0x7f529c0f5a10 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 -- 172.21.15.73:0/2233422773 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c1a9470 con 0x7f529c1a59d0 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529affd700 1 --2- 172.21.15.73:0/2233422773 >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 0x7f529c1a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.080 7f529bfff700 1 --2- 172.21.15.73:0/2233422773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 0x7f529c1a7e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f529c0f47c0 tx=0x7f529400b9a0).ready entity=mon.2 client_cookie=142e429881739fef server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f529a7fc700 1 -- 172.21.15.73:0/2233422773 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f529c1a9470 con 0x7f529c1a59d0 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f529a7fc700 1 -- 172.21.15.73:0/2233422773 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529400d5c0 con 0x7f529c1a59d0 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f529a7fc700 1 -- 172.21.15.73:0/2233422773 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f529400d990 con 0x7f529c1a59d0 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 -- 172.21.15.73:0/2233422773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 msgr2=0x7f529c1a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 --2- 172.21.15.73:0/2233422773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 0x7f529c1a7e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f529c0f47c0 tx=0x7f529400b9a0).stop 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 -- 172.21.15.73:0/2233422773 shutdown_connections 2024-03-24T10:39:25.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 --2- 172.21.15.73:0/2233422773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c1a59d0 0x7f529c1a7e30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 --2- 172.21.15.73:0/2233422773 >> v2:172.21.15.73:3300/0 conn(0x7f529c10b910 0x7f529c1a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 -- 172.21.15.73:0/2233422773 >> 172.21.15.73:0/2233422773 conn(0x7f529c113a70 msgr2=0x7f529c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 -- 172.21.15.73:0/2233422773 shutdown_connections 2024-03-24T10:39:25.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.081 7f52a2ee1700 1 -- 172.21.15.73:0/2233422773 wait complete. 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 Processor -- start 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 -- start start 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 0x7f529c1ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0f2630 con 0x7f529c0d9090 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1ae5c0 con 0x7f529c0d8c40 2024-03-24T10:39:25.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f52a2ee1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1bbb80 con 0x7f529c0f1890 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529b7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 0x7f529c1ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56198/0 (socket says 172.21.15.73:56198) 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529bfff700 1 -- 172.21.15.73:0/1457563753 learned_addr learned my addr 172.21.15.73:0/1457563753 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.104 7f529b7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46306/0 (socket says 172.21.15.73:46306) 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 -- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 msgr2=0x7f529c0d8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 -- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 msgr2=0x7f529c1ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 0x7f529c1ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 -- 172.21.15.73:0/1457563753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c1bbd30 con 0x7f529c0d9090 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529affd700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 0x7f529c1ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529b7fe700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f529bfff700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f529c0c5a20 tx=0x7f52940068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f529c1bbd30 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294011760 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5294011b30 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1bbf30 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.105 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1bc310 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.106 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5294027460 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.106 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5294020120 con 0x7f529c0d9090 2024-03-24T10:39:25.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.106 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c0db120 con 0x7f529c0d9090 2024-03-24T10:39:25.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.109 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5294011550 con 0x7f529c0d9090 2024-03-24T10:39:25.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.212 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f529c087810 con 0x7f52800145b0 2024-03-24T10:39:25.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.220 7f5298ff9700 1 -- 172.21.15.73:0/1457563753 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306141 (unknown 2965378022 0 614797233) 0x7f528c001c00 con 0x7f52800145b0 2024-03-24T10:39:25.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.222 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 >> v1:172.21.15.73:6816/43277 conn(0x7f52800145b0 legacy=0x7f5280016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.222 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 msgr2=0x7f529c1adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.222 7f52a2ee1700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f529c0c5a20 tx=0x7f52940068c0).stop 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 shutdown_connections 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0d9090 0x7f529c1adf90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f529c0f1890 0x7f529c0d8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 --2- 172.21.15.73:0/1457563753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f529c0d8c40 0x7f529c1ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 >> 172.21.15.73:0/1457563753 conn(0x7f529c0c6c70 msgr2=0x7f529c1a51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 shutdown_connections 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.223 7f52a2ee1700 1 -- 172.21.15.73:0/1457563753 wait complete. 2024-03-24T10:39:25.228 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:25.234 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-24 10:39:25.112405","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743122","last_change":"2024-03-24 10:39:21.733062","last_active":"2024-03-24 10:39:21.743122","last_peered":"2024-03-24 10:39:21.743122","last_clean":"2024-03-24 10:39:21.743122","last_became_active":"2024-03-24 10:39:21.732749","last_became_peered":"2024-03-24 10:39:21.732749","last_unstale":"2024-03-24 10:39:21.743122","last_undegraded":"2024-03-24 10:39:21.743122","last_fullsized":"2024-03-24 10:39:21.743122","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723064","last_change":"2024-03-24 10:39:21.410484","last_active":"2024-03-24 10:39:21.723064","last_peered":"2024-03-24 10:39:21.723064","last_clean":"2024-03-24 10:39:21.723064","last_became_active":"2024-03-24 10:39:21.410014","last_became_peered":"2024-03-24 10:39:21.410014","last_unstale":"2024-03-24 10:39:21.723064","last_undegraded":"2024-03-24 10:39:21.723064","last_fullsized":"2024-03-24 10:39:21.723064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756881","last_change":"2024-03-24 10:39:21.754967","last_active":"2024-03-24 10:39:21.756881","last_peered":"2024-03-24 10:39:21.756881","last_clean":"2024-03-24 10:39:21.756881","last_became_active":"2024-03-24 10:39:21.754511","last_became_peered":"2024-03-24 10:39:21.754511","last_unstale":"2024-03-24 10:39:21.756881","last_undegraded":"2024-03-24 10:39:21.756881","last_fullsized":"2024-03-24 10:39:21.756881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722751","last_change":"2024-03-24 10:39:21.405477","last_active":"2024-03-24 10:39:21.722751","last_peered":"2024-03-24 10:39:21.722751","last_clean":"2024-03-24 10:39:21.722751","last_became_active":"2024-03-24 10:39:21.405145","last_became_peered":"2024-03-24 10:39:21.405145","last_unstale":"2024-03-24 10:39:21.722751","last_undegraded":"2024-03-24 10:39:21.722751","last_fullsized":"2024-03-24 10:39:21.722751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750731","last_change":"2024-03-24 10:39:21.749349","last_active":"2024-03-24 10:39:21.750731","last_peered":"2024-03-24 10:39:21.750731","last_clean":"2024-03-24 10:39:21.750731","last_became_active":"2024-03-24 10:39:21.749024","last_became_peered":"2024-03-24 10:39:21.749024","last_unstale":"2024-03-24 10:39:21.750731","last_undegraded":"2024-03-24 10:39:21.750731","last_fullsized":"2024-03-24 10:39:21.750731","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724246","last_change":"2024-03-24 10:39:21.405055","last_active":"2024-03-24 10:39:21.724246","last_peered":"2024-03-24 10:39:21.724246","last_clean":"2024-03-24 10:39:21.724246","last_became_active":"2024-03-24 10:39:21.404748","last_became_peered":"2024-03-24 10:39:21.404748","last_unstale":"2024-03-24 10:39:21.724246","last_undegraded":"2024-03-24 10:39:21.724246","last_fullsized":"2024-03-24 10:39:21.724246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745143","last_change":"2024-03-24 10:39:21.742175","last_active":"2024-03-24 10:39:21.745143","last_peered":"2024-03-24 10:39:21.745143","last_clean":"2024-03-24 10:39:21.745143","last_became_active":"2024-03-24 10:39:21.741904","last_became_peered":"2024-03-24 10:39:21.741904","last_unstale":"2024-03-24 10:39:21.745143","last_undegraded":"2024-03-24 10:39:21.745143","last_fullsized":"2024-03-24 10:39:21.745143","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721675","last_change":"2024-03-24 10:39:21.405185","last_active":"2024-03-24 10:39:21.721675","last_peered":"2024-03-24 10:39:21.721675","last_clean":"2024-03-24 10:39:21.721675","last_became_active":"2024-03-24 10:39:21.404576","last_became_peered":"2024-03-24 10:39:21.404576","last_unstale":"2024-03-24 10:39:21.721675","last_undegraded":"2024-03-24 10:39:21.721675","last_fullsized":"2024-03-24 10:39:21.721675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755187","last_change":"2024-03-24 10:39:21.751864","last_active":"2024-03-24 10:39:21.755187","last_peered":"2024-03-24 10:39:21.755187","last_clean":"2024-03-24 10:39:21.755187","last_became_active":"2024-03-24 10:39:21.751297","last_became_peered":"2024-03-24 10:39:21.751297","last_unstale":"2024-03-24 10:39:21.755187","last_undegraded":"2024-03-24 10:39:21.755187","last_fullsized":"2024-03-24 10:39:21.755187","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724589","last_change":"2024-03-24 10:39:21.393191","last_active":"2024-03-24 10:39:21.724589","last_peered":"2024-03-24 10:39:21.724589","last_clean":"2024-03-24 10:39:21.724589","last_became_active":"2024-03-24 10:39:21.392863","last_became_peered":"2024-03-24 10:39:21.392863","last_unstale":"2024-03-24 10:39:21.724589","last_undegraded":"2024-03-24 10:39:21.724589","last_fullsized":"2024-03-24 10:39:21.724589","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756489","last_change":"2024-03-24 10:39:21.753654","last_active":"2024-03-24 10:39:21.756489","last_peered":"2024-03-24 10:39:21.756489","last_clean":"2024-03-24 10:39:21.756489","last_became_active":"2024-03-24 10:39:21.753306","last_became_peered":"2024-03-24 10:39:21.753306","last_unstale":"2024-03-24 10:39:21.756489","last_undegraded":"2024-03-24 10:39:21.756489","last_fullsized":"2024-03-24 10:39:21.756489","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729807","last_change":"2024-03-24 10:39:21.398093","last_active":"2024-03-24 10:39:21.729807","last_peered":"2024-03-24 10:39:21.729807","last_clean":"2024-03-24 10:39:21.729807","last_became_active":"2024-03-24 10:39:21.397415","last_became_peered":"2024-03-24 10:39:21.397415","last_unstale":"2024-03-24 10:39:21.729807","last_undegraded":"2024-03-24 10:39:21.729807","last_fullsized":"2024-03-24 10:39:21.729807","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748438","last_change":"2024-03-24 10:39:21.746784","last_active":"2024-03-24 10:39:21.748438","last_peered":"2024-03-24 10:39:21.748438","last_clean":"2024-03-24 10:39:21.748438","last_became_active":"2024-03-24 10:39:21.746406","last_became_peered":"2024-03-24 10:39:21.746406","last_unstale":"2024-03-24 10:39:21.748438","last_undegraded":"2024-03-24 10:39:21.748438","last_fullsized":"2024-03-24 10:39:21.748438","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748529","last_change":"2024-03-24 10:39:21.407422","last_active":"2024-03-24 10:39:21.748529","last_peered":"2024-03-24 10:39:21.748529","last_clean":"2024-03-24 10:39:21.748529","last_became_active":"2024-03-24 10:39:21.407030","last_became_peered":"2024-03-24 10:39:21.407030","last_unstale":"2024-03-24 10:39:21.748529","last_undegraded":"2024-03-24 10:39:21.748529","last_fullsized":"2024-03-24 10:39:21.748529","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756688","last_change":"2024-03-24 10:39:21.754359","last_active":"2024-03-24 10:39:21.756688","last_peered":"2024-03-24 10:39:21.756688","last_clean":"2024-03-24 10:39:21.756688","last_became_active":"2024-03-24 10:39:21.754061","last_became_peered":"2024-03-24 10:39:21.754061","last_unstale":"2024-03-24 10:39:21.756688","last_undegraded":"2024-03-24 10:39:21.756688","last_fullsized":"2024-03-24 10:39:21.756688","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750719","last_change":"2024-03-24 10:39:21.389253","last_active":"2024-03-24 10:39:21.750719","last_peered":"2024-03-24 10:39:21.750719","last_clean":"2024-03-24 10:39:21.750719","last_became_active":"2024-03-24 10:39:21.388938","last_became_peered":"2024-03-24 10:39:21.388938","last_unstale":"2024-03-24 10:39:21.750719","last_undegraded":"2024-03-24 10:39:21.750719","last_fullsized":"2024-03-24 10:39:21.750719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748240","last_change":"2024-03-24 10:39:21.743588","last_active":"2024-03-24 10:39:21.748240","last_peered":"2024-03-24 10:39:21.748240","last_clean":"2024-03-24 10:39:21.748240","last_became_active":"2024-03-24 10:39:21.742056","last_became_peered":"2024-03-24 10:39:21.742056","last_unstale":"2024-03-24 10:39:21.748240","last_undegraded":"2024-03-24 10:39:21.748240","last_fullsized":"2024-03-24 10:39:21.748240","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755402","last_change":"2024-03-24 10:39:21.413014","last_active":"2024-03-24 10:39:21.755402","last_peered":"2024-03-24 10:39:21.755402","last_clean":"2024-03-24 10:39:21.755402","last_became_active":"2024-03-24 10:39:21.412716","last_became_peered":"2024-03-24 10:39:21.412716","last_unstale":"2024-03-24 10:39:21.755402","last_undegraded":"2024-03-24 10:39:21.755402","last_fullsized":"2024-03-24 10:39:21.755402","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756575","last_change":"2024-03-24 10:39:21.751937","last_active":"2024-03-24 10:39:21.756575","last_peered":"2024-03-24 10:39:21.756575","last_clean":"2024-03-24 10:39:21.756575","last_became_active":"2024-03-24 10:39:21.751709","last_became_peered":"2024-03-24 10:39:21.751709","last_unstale":"2024-03-24 10:39:21.756575","last_undegraded":"2024-03-24 10:39:21.756575","last_fullsized":"2024-03-24 10:39:21.756575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722537","last_change":"2024-03-24 10:39:21.409360","last_active":"2024-03-24 10:39:21.722537","last_peered":"2024-03-24 10:39:21.722537","last_clean":"2024-03-24 10:39:21.722537","last_became_active":"2024-03-24 10:39:21.409159","last_became_peered":"2024-03-24 10:39:21.409159","last_unstale":"2024-03-24 10:39:21.722537","last_undegraded":"2024-03-24 10:39:21.722537","last_fullsized":"2024-03-24 10:39:21.722537","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743861","last_change":"2024-03-24 10:39:21.733813","last_active":"2024-03-24 10:39:21.743861","last_peered":"2024-03-24 10:39:21.743861","last_clean":"2024-03-24 10:39:21.743861","last_became_active":"2024-03-24 10:39:21.733530","last_became_peered":"2024-03-24 10:39:21.733530","last_unstale":"2024-03-24 10:39:21.743861","last_undegraded":"2024-03-24 10:39:21.743861","last_fullsized":"2024-03-24 10:39:21.743861","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725758","last_change":"2024-03-24 10:39:21.412405","last_active":"2024-03-24 10:39:21.725758","last_peered":"2024-03-24 10:39:21.725758","last_clean":"2024-03-24 10:39:21.725758","last_became_active":"2024-03-24 10:39:21.412066","last_became_peered":"2024-03-24 10:39:21.412066","last_unstale":"2024-03-24 10:39:21.725758","last_undegraded":"2024-03-24 10:39:21.725758","last_fullsized":"2024-03-24 10:39:21.725758","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749646","last_change":"2024-03-24 10:39:21.746871","last_active":"2024-03-24 10:39:21.749646","last_peered":"2024-03-24 10:39:21.749646","last_clean":"2024-03-24 10:39:21.749646","last_became_active":"2024-03-24 10:39:21.746393","last_became_peered":"2024-03-24 10:39:21.746393","last_unstale":"2024-03-24 10:39:21.749646","last_undegraded":"2024-03-24 10:39:21.749646","last_fullsized":"2024-03-24 10:39:21.749646","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745363","last_change":"2024-03-24 10:39:21.386589","last_active":"2024-03-24 10:39:21.745363","last_peered":"2024-03-24 10:39:21.745363","last_clean":"2024-03-24 10:39:21.745363","last_became_active":"2024-03-24 10:39:21.386295","last_became_peered":"2024-03-24 10:39:21.386295","last_unstale":"2024-03-24 10:39:21.745363","last_undegraded":"2024-03-24 10:39:21.745363","last_fullsized":"2024-03-24 10:39:21.745363","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744247","last_change":"2024-03-24 10:39:21.733805","last_active":"2024-03-24 10:39:21.744247","last_peered":"2024-03-24 10:39:21.744247","last_clean":"2024-03-24 10:39:21.744247","last_became_active":"2024-03-24 10:39:21.733501","last_became_peered":"2024-03-24 10:39:21.733501","last_unstale":"2024-03-24 10:39:21.744247","last_undegraded":"2024-03-24 10:39:21.744247","last_fullsized":"2024-03-24 10:39:21.744247","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747691","last_change":"2024-03-24 10:39:21.398400","last_active":"2024-03-24 10:39:21.747691","last_peered":"2024-03-24 10:39:21.747691","last_clean":"2024-03-24 10:39:21.747691","last_became_active":"2024-03-24 10:39:21.397859","last_became_peered":"2024-03-24 10:39:21.397859","last_unstale":"2024-03-24 10:39:21.747691","last_undegraded":"2024-03-24 10:39:21.747691","last_fullsized":"2024-03-24 10:39:21.747691","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747817","last_change":"2024-03-24 10:39:21.741686","last_active":"2024-03-24 10:39:21.747817","last_peered":"2024-03-24 10:39:21.747817","last_clean":"2024-03-24 10:39:21.747817","last_became_active":"2024-03-24 10:39:21.741119","last_became_peered":"2024-03-24 10:39:21.741119","last_unstale":"2024-03-24 10:39:21.747817","last_undegraded":"2024-03-24 10:39:21.747817","last_fullsized":"2024-03-24 10:39:21.747817","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752068","last_change":"2024-03-24 10:39:21.389678","last_active":"2024-03-24 10:39:21.752068","last_peered":"2024-03-24 10:39:21.752068","last_clean":"2024-03-24 10:39:21.752068","last_became_active":"2024-03-24 10:39:21.389377","last_became_peered":"2024-03-24 10:39:21.389377","last_unstale":"2024-03-24 10:39:21.752068","last_undegraded":"2024-03-24 10:39:21.752068","last_fullsized":"2024-03-24 10:39:21.752068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748099","last_change":"2024-03-24 10:39:21.742841","last_active":"2024-03-24 10:39:21.748099","last_peered":"2024-03-24 10:39:21.748099","last_clean":"2024-03-24 10:39:21.748099","last_became_active":"2024-03-24 10:39:21.742567","last_became_peered":"2024-03-24 10:39:21.742567","last_unstale":"2024-03-24 10:39:21.748099","last_undegraded":"2024-03-24 10:39:21.748099","last_fullsized":"2024-03-24 10:39:21.748099","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722471","last_change":"2024-03-24 10:39:21.407601","last_active":"2024-03-24 10:39:21.722471","last_peered":"2024-03-24 10:39:21.722471","last_clean":"2024-03-24 10:39:21.722471","last_became_active":"2024-03-24 10:39:21.407123","last_became_peered":"2024-03-24 10:39:21.407123","last_unstale":"2024-03-24 10:39:21.722471","last_undegraded":"2024-03-24 10:39:21.722471","last_fullsized":"2024-03-24 10:39:21.722471","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747918","last_change":"2024-03-24 10:39:21.741427","last_active":"2024-03-24 10:39:21.747918","last_peered":"2024-03-24 10:39:21.747918","last_clean":"2024-03-24 10:39:21.747918","last_became_active":"2024-03-24 10:39:21.741202","last_became_peered":"2024-03-24 10:39:21.741202","last_unstale":"2024-03-24 10:39:21.747918","last_undegraded":"2024-03-24 10:39:21.747918","last_fullsized":"2024-03-24 10:39:21.747918","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716544","last_change":"2024-03-24 10:39:21.397164","last_active":"2024-03-24 10:39:21.716544","last_peered":"2024-03-24 10:39:21.716544","last_clean":"2024-03-24 10:39:21.716544","last_became_active":"2024-03-24 10:39:21.396867","last_became_peered":"2024-03-24 10:39:21.396867","last_unstale":"2024-03-24 10:39:21.716544","last_undegraded":"2024-03-24 10:39:21.716544","last_fullsized":"2024-03-24 10:39:21.716544","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747260","last_change":"2024-03-24 10:39:21.740995","last_active":"2024-03-24 10:39:21.747260","last_peered":"2024-03-24 10:39:21.747260","last_clean":"2024-03-24 10:39:21.747260","last_became_active":"2024-03-24 10:39:21.740697","last_became_peered":"2024-03-24 10:39:21.740697","last_unstale":"2024-03-24 10:39:21.747260","last_undegraded":"2024-03-24 10:39:21.747260","last_fullsized":"2024-03-24 10:39:21.747260","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749980","last_change":"2024-03-24 10:39:21.411252","last_active":"2024-03-24 10:39:21.749980","last_peered":"2024-03-24 10:39:21.749980","last_clean":"2024-03-24 10:39:21.749980","last_became_active":"2024-03-24 10:39:21.410965","last_became_peered":"2024-03-24 10:39:21.410965","last_unstale":"2024-03-24 10:39:21.749980","last_undegraded":"2024-03-24 10:39:21.749980","last_fullsized":"2024-03-24 10:39:21.749980","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750603","last_change":"2024-03-24 10:39:21.749883","last_active":"2024-03-24 10:39:21.750603","last_peered":"2024-03-24 10:39:21.750603","last_clean":"2024-03-24 10:39:21.750603","last_became_active":"2024-03-24 10:39:21.749521","last_became_peered":"2024-03-24 10:39:21.749521","last_unstale":"2024-03-24 10:39:21.750603","last_undegraded":"2024-03-24 10:39:21.750603","last_fullsized":"2024-03-24 10:39:21.750603","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725159","last_change":"2024-03-24 10:39:21.396016","last_active":"2024-03-24 10:39:21.725159","last_peered":"2024-03-24 10:39:21.725159","last_clean":"2024-03-24 10:39:21.725159","last_became_active":"2024-03-24 10:39:21.395496","last_became_peered":"2024-03-24 10:39:21.395496","last_unstale":"2024-03-24 10:39:21.725159","last_undegraded":"2024-03-24 10:39:21.725159","last_fullsized":"2024-03-24 10:39:21.725159","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748341","last_change":"2024-03-24 10:39:21.741529","last_active":"2024-03-24 10:39:21.748341","last_peered":"2024-03-24 10:39:21.748341","last_clean":"2024-03-24 10:39:21.748341","last_became_active":"2024-03-24 10:39:21.741235","last_became_peered":"2024-03-24 10:39:21.741235","last_unstale":"2024-03-24 10:39:21.748341","last_undegraded":"2024-03-24 10:39:21.748341","last_fullsized":"2024-03-24 10:39:21.748341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.719089","last_change":"2024-03-24 10:39:21.401865","last_active":"2024-03-24 10:39:21.719089","last_peered":"2024-03-24 10:39:21.719089","last_clean":"2024-03-24 10:39:21.719089","last_became_active":"2024-03-24 10:39:21.401590","last_became_peered":"2024-03-24 10:39:21.401590","last_unstale":"2024-03-24 10:39:21.719089","last_undegraded":"2024-03-24 10:39:21.719089","last_fullsized":"2024-03-24 10:39:21.719089","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749696","last_change":"2024-03-24 10:39:21.747518","last_active":"2024-03-24 10:39:21.749696","last_peered":"2024-03-24 10:39:21.749696","last_clean":"2024-03-24 10:39:21.749696","last_became_active":"2024-03-24 10:39:21.746543","last_became_peered":"2024-03-24 10:39:21.746543","last_unstale":"2024-03-24 10:39:21.749696","last_undegraded":"2024-03-24 10:39:21.749696","last_fullsized":"2024-03-24 10:39:21.749696","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723834","last_change":"2024-03-24 10:39:21.398690","last_active":"2024-03-24 10:39:21.723834","last_peered":"2024-03-24 10:39:21.723834","last_clean":"2024-03-24 10:39:21.723834","last_became_active":"2024-03-24 10:39:21.398369","last_became_peered":"2024-03-24 10:39:21.398369","last_unstale":"2024-03-24 10:39:21.723834","last_undegraded":"2024-03-24 10:39:21.723834","last_fullsized":"2024-03-24 10:39:21.723834","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748298","last_change":"2024-03-24 10:39:21.745829","last_active":"2024-03-24 10:39:21.748298","last_peered":"2024-03-24 10:39:21.748298","last_clean":"2024-03-24 10:39:21.748298","last_became_active":"2024-03-24 10:39:21.745472","last_became_peered":"2024-03-24 10:39:21.745472","last_unstale":"2024-03-24 10:39:21.748298","last_undegraded":"2024-03-24 10:39:21.748298","last_fullsized":"2024-03-24 10:39:21.748298","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718093","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:21.718093","last_peered":"2024-03-24 10:39:21.718093","last_clean":"2024-03-24 10:39:21.718093","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:21.718093","last_undegraded":"2024-03-24 10:39:21.718093","last_fullsized":"2024-03-24 10:39:21.718093","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724305","last_change":"2024-03-24 10:39:21.400473","last_active":"2024-03-24 10:39:21.724305","last_peered":"2024-03-24 10:39:21.724305","last_clean":"2024-03-24 10:39:21.724305","last_became_active":"2024-03-24 10:39:21.400199","last_became_peered":"2024-03-24 10:39:21.400199","last_unstale":"2024-03-24 10:39:21.724305","last_undegraded":"2024-03-24 10:39:21.724305","last_fullsized":"2024-03-24 10:39:21.724305","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748222","last_change":"2024-03-24 10:39:21.743515","last_active":"2024-03-24 10:39:21.748222","last_peered":"2024-03-24 10:39:21.748222","last_clean":"2024-03-24 10:39:21.748222","last_became_active":"2024-03-24 10:39:21.740628","last_became_peered":"2024-03-24 10:39:21.740628","last_unstale":"2024-03-24 10:39:21.748222","last_undegraded":"2024-03-24 10:39:21.748222","last_fullsized":"2024-03-24 10:39:21.748222","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726669","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:21.726669","last_peered":"2024-03-24 10:39:21.726669","last_clean":"2024-03-24 10:39:21.726669","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:21.726669","last_undegraded":"2024-03-24 10:39:21.726669","last_fullsized":"2024-03-24 10:39:21.726669","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751900","last_change":"2024-03-24 10:39:21.410337","last_active":"2024-03-24 10:39:21.751900","last_peered":"2024-03-24 10:39:21.751900","last_clean":"2024-03-24 10:39:21.751900","last_became_active":"2024-03-24 10:39:21.410037","last_became_peered":"2024-03-24 10:39:21.410037","last_unstale":"2024-03-24 10:39:21.751900","last_undegraded":"2024-03-24 10:39:21.751900","last_fullsized":"2024-03-24 10:39:21.751900","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722808","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:21.722808","last_peered":"2024-03-24 10:39:21.722808","last_clean":"2024-03-24 10:39:21.722808","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:21.722808","last_undegraded":"2024-03-24 10:39:21.722808","last_fullsized":"2024-03-24 10:39:21.722808","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721775","last_change":"2024-03-24 10:39:21.405373","last_active":"2024-03-24 10:39:21.721775","last_peered":"2024-03-24 10:39:21.721775","last_clean":"2024-03-24 10:39:21.721775","last_became_active":"2024-03-24 10:39:21.404592","last_became_peered":"2024-03-24 10:39:21.404592","last_unstale":"2024-03-24 10:39:21.721775","last_undegraded":"2024-03-24 10:39:21.721775","last_fullsized":"2024-03-24 10:39:21.721775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745772","last_change":"2024-03-24 10:39:21.736241","last_active":"2024-03-24 10:39:21.745772","last_peered":"2024-03-24 10:39:21.745772","last_clean":"2024-03-24 10:39:21.745772","last_became_active":"2024-03-24 10:39:21.732484","last_became_peered":"2024-03-24 10:39:21.732484","last_unstale":"2024-03-24 10:39:21.745772","last_undegraded":"2024-03-24 10:39:21.745772","last_fullsized":"2024-03-24 10:39:21.745772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726569","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:21.726569","last_peered":"2024-03-24 10:39:21.726569","last_clean":"2024-03-24 10:39:21.726569","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:21.726569","last_undegraded":"2024-03-24 10:39:21.726569","last_fullsized":"2024-03-24 10:39:21.726569","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715418","last_change":"2024-03-24 10:39:21.386180","last_active":"2024-03-24 10:39:21.715418","last_peered":"2024-03-24 10:39:21.715418","last_clean":"2024-03-24 10:39:21.715418","last_became_active":"2024-03-24 10:39:21.385860","last_became_peered":"2024-03-24 10:39:21.385860","last_unstale":"2024-03-24 10:39:21.715418","last_undegraded":"2024-03-24 10:39:21.715418","last_fullsized":"2024-03-24 10:39:21.715418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743840","last_change":"2024-03-24 10:39:21.733305","last_active":"2024-03-24 10:39:21.743840","last_peered":"2024-03-24 10:39:21.743840","last_clean":"2024-03-24 10:39:21.743840","last_became_active":"2024-03-24 10:39:21.732991","last_became_peered":"2024-03-24 10:39:21.732991","last_unstale":"2024-03-24 10:39:21.743840","last_undegraded":"2024-03-24 10:39:21.743840","last_fullsized":"2024-03-24 10:39:21.743840","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.720076","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:21.720076","last_peered":"2024-03-24 10:39:21.720076","last_clean":"2024-03-24 10:39:21.720076","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:21.720076","last_undegraded":"2024-03-24 10:39:21.720076","last_fullsized":"2024-03-24 10:39:21.720076","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722676","last_change":"2024-03-24 10:39:21.410670","last_active":"2024-03-24 10:39:21.722676","last_peered":"2024-03-24 10:39:21.722676","last_clean":"2024-03-24 10:39:21.722676","last_became_active":"2024-03-24 10:39:21.410239","last_became_peered":"2024-03-24 10:39:21.410239","last_unstale":"2024-03-24 10:39:21.722676","last_undegraded":"2024-03-24 10:39:21.722676","last_fullsized":"2024-03-24 10:39:21.722676","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744919","last_change":"2024-03-24 10:39:21.734952","last_active":"2024-03-24 10:39:21.744919","last_peered":"2024-03-24 10:39:21.744919","last_clean":"2024-03-24 10:39:21.744919","last_became_active":"2024-03-24 10:39:21.734666","last_became_peered":"2024-03-24 10:39:21.734666","last_unstale":"2024-03-24 10:39:21.744919","last_undegraded":"2024-03-24 10:39:21.744919","last_fullsized":"2024-03-24 10:39:21.744919","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724151","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:21.724151","last_peered":"2024-03-24 10:39:21.724151","last_clean":"2024-03-24 10:39:21.724151","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:21.724151","last_undegraded":"2024-03-24 10:39:21.724151","last_fullsized":"2024-03-24 10:39:21.724151","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722647","last_change":"2024-03-24 10:39:21.406436","last_active":"2024-03-24 10:39:21.722647","last_peered":"2024-03-24 10:39:21.722647","last_clean":"2024-03-24 10:39:21.722647","last_became_active":"2024-03-24 10:39:21.406101","last_became_peered":"2024-03-24 10:39:21.406101","last_unstale":"2024-03-24 10:39:21.722647","last_undegraded":"2024-03-24 10:39:21.722647","last_fullsized":"2024-03-24 10:39:21.722647","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737910","last_change":"2024-03-24 10:39:21.731561","last_active":"2024-03-24 10:39:21.737910","last_peered":"2024-03-24 10:39:21.737910","last_clean":"2024-03-24 10:39:21.737910","last_became_active":"2024-03-24 10:39:21.730998","last_became_peered":"2024-03-24 10:39:21.730998","last_unstale":"2024-03-24 10:39:21.737910","last_undegraded":"2024-03-24 10:39:21.737910","last_fullsized":"2024-03-24 10:39:21.737910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.727104","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:21.727104","last_peered":"2024-03-24 10:39:21.727104","last_clean":"2024-03-24 10:39:21.727104","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:21.727104","last_undegraded":"2024-03-24 10:39:21.727104","last_fullsized":"2024-03-24 10:39:21.727104","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726454","last_change":"2024-03-24 10:39:21.407528","last_active":"2024-03-24 10:39:21.726454","last_peered":"2024-03-24 10:39:21.726454","last_clean":"2024-03-24 10:39:21.726454","last_became_active":"2024-03-24 10:39:21.407090","last_became_peered":"2024-03-24 10:39:21.407090","last_unstale":"2024-03-24 10:39:21.726454","last_undegraded":"2024-03-24 10:39:21.726454","last_fullsized":"2024-03-24 10:39:21.726454","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745252","last_change":"2024-03-24 10:39:21.737964","last_active":"2024-03-24 10:39:21.745252","last_peered":"2024-03-24 10:39:21.745252","last_clean":"2024-03-24 10:39:21.745252","last_became_active":"2024-03-24 10:39:21.736699","last_became_peered":"2024-03-24 10:39:21.736699","last_unstale":"2024-03-24 10:39:21.745252","last_undegraded":"2024-03-24 10:39:21.745252","last_fullsized":"2024-03-24 10:39:21.745252","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724662","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:21.724662","last_peered":"2024-03-24 10:39:21.724662","last_clean":"2024-03-24 10:39:21.724662","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:21.724662","last_undegraded":"2024-03-24 10:39:21.724662","last_fullsized":"2024-03-24 10:39:21.724662","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723118","last_change":"2024-03-24 10:39:21.402542","last_active":"2024-03-24 10:39:21.723118","last_peered":"2024-03-24 10:39:21.723118","last_clean":"2024-03-24 10:39:21.723118","last_became_active":"2024-03-24 10:39:21.402228","last_became_peered":"2024-03-24 10:39:21.402228","last_unstale":"2024-03-24 10:39:21.723118","last_undegraded":"2024-03-24 10:39:21.723118","last_fullsized":"2024-03-24 10:39:21.723118","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738540","last_change":"2024-03-24 10:39:21.730414","last_active":"2024-03-24 10:39:21.738540","last_peered":"2024-03-24 10:39:21.738540","last_clean":"2024-03-24 10:39:21.738540","last_became_active":"2024-03-24 10:39:21.730157","last_became_peered":"2024-03-24 10:39:21.730157","last_unstale":"2024-03-24 10:39:21.738540","last_undegraded":"2024-03-24 10:39:21.738540","last_fullsized":"2024-03-24 10:39:21.738540","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756740","last_change":"2024-03-24 10:39:21.753593","last_active":"2024-03-24 10:39:21.756740","last_peered":"2024-03-24 10:39:21.756740","last_clean":"2024-03-24 10:39:21.756740","last_became_active":"2024-03-24 10:39:21.753209","last_became_peered":"2024-03-24 10:39:21.753209","last_unstale":"2024-03-24 10:39:21.756740","last_undegraded":"2024-03-24 10:39:21.756740","last_fullsized":"2024-03-24 10:39:21.756740","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729205","last_change":"2024-03-24 10:39:21.403995","last_active":"2024-03-24 10:39:21.729205","last_peered":"2024-03-24 10:39:21.729205","last_clean":"2024-03-24 10:39:21.729205","last_became_active":"2024-03-24 10:39:21.403652","last_became_peered":"2024-03-24 10:39:21.403652","last_unstale":"2024-03-24 10:39:21.729205","last_undegraded":"2024-03-24 10:39:21.729205","last_fullsized":"2024-03-24 10:39:21.729205","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745272","last_change":"2024-03-24 10:39:21.738871","last_active":"2024-03-24 10:39:21.745272","last_peered":"2024-03-24 10:39:21.745272","last_clean":"2024-03-24 10:39:21.745272","last_became_active":"2024-03-24 10:39:21.738567","last_became_peered":"2024-03-24 10:39:21.738567","last_unstale":"2024-03-24 10:39:21.745272","last_undegraded":"2024-03-24 10:39:21.745272","last_fullsized":"2024-03-24 10:39:21.745272","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748037","last_change":"2024-03-24 10:39:21.402898","last_active":"2024-03-24 10:39:21.748037","last_peered":"2024-03-24 10:39:21.748037","last_clean":"2024-03-24 10:39:21.748037","last_became_active":"2024-03-24 10:39:21.402655","last_became_peered":"2024-03-24 10:39:21.402655","last_unstale":"2024-03-24 10:39:21.748037","last_undegraded":"2024-03-24 10:39:21.748037","last_fullsized":"2024-03-24 10:39:21.748037","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747775","last_change":"2024-03-24 10:39:21.741510","last_active":"2024-03-24 10:39:21.747775","last_peered":"2024-03-24 10:39:21.747775","last_clean":"2024-03-24 10:39:21.747775","last_became_active":"2024-03-24 10:39:21.740907","last_became_peered":"2024-03-24 10:39:21.740907","last_unstale":"2024-03-24 10:39:21.747775","last_undegraded":"2024-03-24 10:39:21.747775","last_fullsized":"2024-03-24 10:39:21.747775","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752967","last_change":"2024-03-24 10:39:21.406729","last_active":"2024-03-24 10:39:21.752967","last_peered":"2024-03-24 10:39:21.752967","last_clean":"2024-03-24 10:39:21.752967","last_became_active":"2024-03-24 10:39:21.406428","last_became_peered":"2024-03-24 10:39:21.406428","last_unstale":"2024-03-24 10:39:21.752967","last_undegraded":"2024-03-24 10:39:21.752967","last_fullsized":"2024-03-24 10:39:21.752967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751571","last_change":"2024-03-24 10:39:21.750478","last_active":"2024-03-24 10:39:21.751571","last_peered":"2024-03-24 10:39:21.751571","last_clean":"2024-03-24 10:39:21.751571","last_became_active":"2024-03-24 10:39:21.750180","last_became_peered":"2024-03-24 10:39:21.750180","last_unstale":"2024-03-24 10:39:21.751571","last_undegraded":"2024-03-24 10:39:21.751571","last_fullsized":"2024-03-24 10:39:21.751571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.753802","last_change":"2024-03-24 10:39:21.411578","last_active":"2024-03-24 10:39:21.753802","last_peered":"2024-03-24 10:39:21.753802","last_clean":"2024-03-24 10:39:21.753802","last_became_active":"2024-03-24 10:39:21.410949","last_became_peered":"2024-03-24 10:39:21.410949","last_unstale":"2024-03-24 10:39:21.753802","last_undegraded":"2024-03-24 10:39:21.753802","last_fullsized":"2024-03-24 10:39:21.753802","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738381","last_change":"2024-03-24 10:39:21.729490","last_active":"2024-03-24 10:39:21.738381","last_peered":"2024-03-24 10:39:21.738381","last_clean":"2024-03-24 10:39:21.738381","last_became_active":"2024-03-24 10:39:21.729213","last_became_peered":"2024-03-24 10:39:21.729213","last_unstale":"2024-03-24 10:39:21.738381","last_undegraded":"2024-03-24 10:39:21.738381","last_fullsized":"2024-03-24 10:39:21.738381","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722050","last_change":"2024-03-24 10:39:21.405449","last_active":"2024-03-24 10:39:21.722050","last_peered":"2024-03-24 10:39:21.722050","last_clean":"2024-03-24 10:39:21.722050","last_became_active":"2024-03-24 10:39:21.404858","last_became_peered":"2024-03-24 10:39:21.404858","last_unstale":"2024-03-24 10:39:21.722050","last_undegraded":"2024-03-24 10:39:21.722050","last_fullsized":"2024-03-24 10:39:21.722050","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744150","last_change":"2024-03-24 10:39:21.734494","last_active":"2024-03-24 10:39:21.744150","last_peered":"2024-03-24 10:39:21.744150","last_clean":"2024-03-24 10:39:21.744150","last_became_active":"2024-03-24 10:39:21.734226","last_became_peered":"2024-03-24 10:39:21.734226","last_unstale":"2024-03-24 10:39:21.744150","last_undegraded":"2024-03-24 10:39:21.744150","last_fullsized":"2024-03-24 10:39:21.744150","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715521","last_change":"2024-03-24 10:39:21.393879","last_active":"2024-03-24 10:39:21.715521","last_peered":"2024-03-24 10:39:21.715521","last_clean":"2024-03-24 10:39:21.715521","last_became_active":"2024-03-24 10:39:21.393571","last_became_peered":"2024-03-24 10:39:21.393571","last_unstale":"2024-03-24 10:39:21.715521","last_undegraded":"2024-03-24 10:39:21.715521","last_fullsized":"2024-03-24 10:39:21.715521","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756857","last_change":"2024-03-24 10:39:21.754801","last_active":"2024-03-24 10:39:21.756857","last_peered":"2024-03-24 10:39:21.756857","last_clean":"2024-03-24 10:39:21.756857","last_became_active":"2024-03-24 10:39:21.754290","last_became_peered":"2024-03-24 10:39:21.754290","last_unstale":"2024-03-24 10:39:21.756857","last_undegraded":"2024-03-24 10:39:21.756857","last_fullsized":"2024-03-24 10:39:21.756857","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722857","last_change":"2024-03-24 10:39:21.413325","last_active":"2024-03-24 10:39:21.722857","last_peered":"2024-03-24 10:39:21.722857","last_clean":"2024-03-24 10:39:21.722857","last_became_active":"2024-03-24 10:39:21.412968","last_became_peered":"2024-03-24 10:39:21.412968","last_unstale":"2024-03-24 10:39:21.722857","last_undegraded":"2024-03-24 10:39:21.722857","last_fullsized":"2024-03-24 10:39:21.722857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750074","last_change":"2024-03-24 10:39:21.749344","last_active":"2024-03-24 10:39:21.750074","last_peered":"2024-03-24 10:39:21.750074","last_clean":"2024-03-24 10:39:21.750074","last_became_active":"2024-03-24 10:39:21.748994","last_became_peered":"2024-03-24 10:39:21.748994","last_unstale":"2024-03-24 10:39:21.750074","last_undegraded":"2024-03-24 10:39:21.750074","last_fullsized":"2024-03-24 10:39:21.750074","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723365","last_change":"2024-03-24 10:39:21.406440","last_active":"2024-03-24 10:39:21.723365","last_peered":"2024-03-24 10:39:21.723365","last_clean":"2024-03-24 10:39:21.723365","last_became_active":"2024-03-24 10:39:21.406223","last_became_peered":"2024-03-24 10:39:21.406223","last_unstale":"2024-03-24 10:39:21.723365","last_undegraded":"2024-03-24 10:39:21.723365","last_fullsized":"2024-03-24 10:39:21.723365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744941","last_change":"2024-03-24 10:39:21.735015","last_active":"2024-03-24 10:39:21.744941","last_peered":"2024-03-24 10:39:21.744941","last_clean":"2024-03-24 10:39:21.744941","last_became_active":"2024-03-24 10:39:21.734736","last_became_peered":"2024-03-24 10:39:21.734736","last_unstale":"2024-03-24 10:39:21.744941","last_undegraded":"2024-03-24 10:39:21.744941","last_fullsized":"2024-03-24 10:39:21.744941","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723220","last_change":"2024-03-24 10:39:21.402419","last_active":"2024-03-24 10:39:21.723220","last_peered":"2024-03-24 10:39:21.723220","last_clean":"2024-03-24 10:39:21.723220","last_became_active":"2024-03-24 10:39:21.402129","last_became_peered":"2024-03-24 10:39:21.402129","last_unstale":"2024-03-24 10:39:21.723220","last_undegraded":"2024-03-24 10:39:21.723220","last_fullsized":"2024-03-24 10:39:21.723220","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756584","last_change":"2024-03-24 10:39:21.752207","last_active":"2024-03-24 10:39:21.756584","last_peered":"2024-03-24 10:39:21.756584","last_clean":"2024-03-24 10:39:21.756584","last_became_active":"2024-03-24 10:39:21.751891","last_became_peered":"2024-03-24 10:39:21.751891","last_unstale":"2024-03-24 10:39:21.756584","last_undegraded":"2024-03-24 10:39:21.756584","last_fullsized":"2024-03-24 10:39:21.756584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718129","last_change":"2024-03-24 10:39:21.396998","last_active":"2024-03-24 10:39:21.718129","last_peered":"2024-03-24 10:39:21.718129","last_clean":"2024-03-24 10:39:21.718129","last_became_active":"2024-03-24 10:39:21.396640","last_became_peered":"2024-03-24 10:39:21.396640","last_unstale":"2024-03-24 10:39:21.718129","last_undegraded":"2024-03-24 10:39:21.718129","last_fullsized":"2024-03-24 10:39:21.718129","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750006","last_change":"2024-03-24 10:39:21.747974","last_active":"2024-03-24 10:39:21.750006","last_peered":"2024-03-24 10:39:21.750006","last_clean":"2024-03-24 10:39:21.750006","last_became_active":"2024-03-24 10:39:21.742188","last_became_peered":"2024-03-24 10:39:21.742188","last_unstale":"2024-03-24 10:39:21.750006","last_undegraded":"2024-03-24 10:39:21.750006","last_fullsized":"2024-03-24 10:39:21.750006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-03-24 10:39:23.028062","last_change":"2024-03-24 10:39:21.412507","last_active":"2024-03-24 10:39:23.028062","last_peered":"2024-03-24 10:39:23.028062","last_clean":"2024-03-24 10:39:23.028062","last_became_active":"2024-03-24 10:39:21.412194","last_became_peered":"2024-03-24 10:39:21.412194","last_unstale":"2024-03-24 10:39:23.028062","last_undegraded":"2024-03-24 10:39:23.028062","last_fullsized":"2024-03-24 10:39:23.028062","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755163","last_change":"2024-03-24 10:39:21.751687","last_active":"2024-03-24 10:39:21.755163","last_peered":"2024-03-24 10:39:21.755163","last_clean":"2024-03-24 10:39:21.755163","last_became_active":"2024-03-24 10:39:21.751067","last_became_peered":"2024-03-24 10:39:21.751067","last_unstale":"2024-03-24 10:39:21.755163","last_undegraded":"2024-03-24 10:39:21.755163","last_fullsized":"2024-03-24 10:39:21.755163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726350","last_change":"2024-03-24 10:39:21.409431","last_active":"2024-03-24 10:39:21.726350","last_peered":"2024-03-24 10:39:21.726350","last_clean":"2024-03-24 10:39:21.726350","last_became_active":"2024-03-24 10:39:21.409077","last_became_peered":"2024-03-24 10:39:21.409077","last_unstale":"2024-03-24 10:39:21.726350","last_undegraded":"2024-03-24 10:39:21.726350","last_fullsized":"2024-03-24 10:39:21.726350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748566","last_change":"2024-03-24 10:39:21.746704","last_active":"2024-03-24 10:39:21.748566","last_peered":"2024-03-24 10:39:21.748566","last_clean":"2024-03-24 10:39:21.748566","last_became_active":"2024-03-24 10:39:21.746288","last_became_peered":"2024-03-24 10:39:21.746288","last_unstale":"2024-03-24 10:39:21.748566","last_undegraded":"2024-03-24 10:39:21.748566","last_fullsized":"2024-03-24 10:39:21.748566","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722735","last_change":"2024-03-24 10:39:21.405622","last_active":"2024-03-24 10:39:21.722735","last_peered":"2024-03-24 10:39:21.722735","last_clean":"2024-03-24 10:39:21.722735","last_became_active":"2024-03-24 10:39:21.405031","last_became_peered":"2024-03-24 10:39:21.405031","last_unstale":"2024-03-24 10:39:21.722735","last_undegraded":"2024-03-24 10:39:21.722735","last_fullsized":"2024-03-24 10:39:21.722735","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749673","last_change":"2024-03-24 10:39:21.747203","last_active":"2024-03-24 10:39:21.749673","last_peered":"2024-03-24 10:39:21.749673","last_clean":"2024-03-24 10:39:21.749673","last_became_active":"2024-03-24 10:39:21.746669","last_became_peered":"2024-03-24 10:39:21.746669","last_unstale":"2024-03-24 10:39:21.749673","last_undegraded":"2024-03-24 10:39:21.749673","last_fullsized":"2024-03-24 10:39:21.749673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722465","last_change":"2024-03-24 10:39:21.401363","last_active":"2024-03-24 10:39:21.722465","last_peered":"2024-03-24 10:39:21.722465","last_clean":"2024-03-24 10:39:21.722465","last_became_active":"2024-03-24 10:39:21.401068","last_became_peered":"2024-03-24 10:39:21.401068","last_unstale":"2024-03-24 10:39:21.722465","last_undegraded":"2024-03-24 10:39:21.722465","last_fullsized":"2024-03-24 10:39:21.722465","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737930","last_change":"2024-03-24 10:39:21.731704","last_active":"2024-03-24 10:39:21.737930","last_peered":"2024-03-24 10:39:21.737930","last_clean":"2024-03-24 10:39:21.737930","last_became_active":"2024-03-24 10:39:21.731209","last_became_peered":"2024-03-24 10:39:21.731209","last_unstale":"2024-03-24 10:39:21.737930","last_undegraded":"2024-03-24 10:39:21.737930","last_fullsized":"2024-03-24 10:39:21.737930","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725064","last_change":"2024-03-24 10:39:21.396241","last_active":"2024-03-24 10:39:21.725064","last_peered":"2024-03-24 10:39:21.725064","last_clean":"2024-03-24 10:39:21.725064","last_became_active":"2024-03-24 10:39:21.395775","last_became_peered":"2024-03-24 10:39:21.395775","last_unstale":"2024-03-24 10:39:21.725064","last_undegraded":"2024-03-24 10:39:21.725064","last_fullsized":"2024-03-24 10:39:21.725064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745178","last_change":"2024-03-24 10:39:21.738160","last_active":"2024-03-24 10:39:21.745178","last_peered":"2024-03-24 10:39:21.745178","last_clean":"2024-03-24 10:39:21.745178","last_became_active":"2024-03-24 10:39:21.737855","last_became_peered":"2024-03-24 10:39:21.737855","last_unstale":"2024-03-24 10:39:21.745178","last_undegraded":"2024-03-24 10:39:21.745178","last_fullsized":"2024-03-24 10:39:21.745178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750738","last_change":"2024-03-24 10:39:21.398871","last_active":"2024-03-24 10:39:21.750738","last_peered":"2024-03-24 10:39:21.750738","last_clean":"2024-03-24 10:39:21.750738","last_became_active":"2024-03-24 10:39:21.398558","last_became_peered":"2024-03-24 10:39:21.398558","last_unstale":"2024-03-24 10:39:21.750738","last_undegraded":"2024-03-24 10:39:21.750738","last_fullsized":"2024-03-24 10:39:21.750738","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748448","last_change":"2024-03-24 10:39:21.746721","last_active":"2024-03-24 10:39:21.748448","last_peered":"2024-03-24 10:39:21.748448","last_clean":"2024-03-24 10:39:21.748448","last_became_active":"2024-03-24 10:39:21.746369","last_became_peered":"2024-03-24 10:39:21.746369","last_unstale":"2024-03-24 10:39:21.748448","last_undegraded":"2024-03-24 10:39:21.748448","last_fullsized":"2024-03-24 10:39:21.748448","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716479","last_change":"2024-03-24 10:39:21.397102","last_active":"2024-03-24 10:39:21.716479","last_peered":"2024-03-24 10:39:21.716479","last_clean":"2024-03-24 10:39:21.716479","last_became_active":"2024-03-24 10:39:21.396712","last_became_peered":"2024-03-24 10:39:21.396712","last_unstale":"2024-03-24 10:39:21.716479","last_undegraded":"2024-03-24 10:39:21.716479","last_fullsized":"2024-03-24 10:39:21.716479","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748075","last_change":"2024-03-24 10:39:21.742483","last_active":"2024-03-24 10:39:21.748075","last_peered":"2024-03-24 10:39:21.748075","last_clean":"2024-03-24 10:39:21.748075","last_became_active":"2024-03-24 10:39:21.740541","last_became_peered":"2024-03-24 10:39:21.740541","last_unstale":"2024-03-24 10:39:21.748075","last_undegraded":"2024-03-24 10:39:21.748075","last_fullsized":"2024-03-24 10:39:21.748075","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750097","last_change":"2024-03-24 10:39:21.411702","last_active":"2024-03-24 10:39:21.750097","last_peered":"2024-03-24 10:39:21.750097","last_clean":"2024-03-24 10:39:21.750097","last_became_active":"2024-03-24 10:39:21.410083","last_became_peered":"2024-03-24 10:39:21.410083","last_unstale":"2024-03-24 10:39:21.750097","last_undegraded":"2024-03-24 10:39:21.750097","last_fullsized":"2024-03-24 10:39:21.750097","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750114","last_change":"2024-03-24 10:39:21.749409","last_active":"2024-03-24 10:39:21.750114","last_peered":"2024-03-24 10:39:21.750114","last_clean":"2024-03-24 10:39:21.750114","last_became_active":"2024-03-24 10:39:21.749109","last_became_peered":"2024-03-24 10:39:21.749109","last_unstale":"2024-03-24 10:39:21.750114","last_undegraded":"2024-03-24 10:39:21.750114","last_fullsized":"2024-03-24 10:39:21.750114","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724400","last_change":"2024-03-24 10:39:21.400428","last_active":"2024-03-24 10:39:21.724400","last_peered":"2024-03-24 10:39:21.724400","last_clean":"2024-03-24 10:39:21.724400","last_became_active":"2024-03-24 10:39:21.400131","last_became_peered":"2024-03-24 10:39:21.400131","last_unstale":"2024-03-24 10:39:21.724400","last_undegraded":"2024-03-24 10:39:21.724400","last_fullsized":"2024-03-24 10:39:21.724400","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744265","last_change":"2024-03-24 10:39:21.735779","last_active":"2024-03-24 10:39:21.744265","last_peered":"2024-03-24 10:39:21.744265","last_clean":"2024-03-24 10:39:21.744265","last_became_active":"2024-03-24 10:39:21.735484","last_became_peered":"2024-03-24 10:39:21.735484","last_unstale":"2024-03-24 10:39:21.744265","last_undegraded":"2024-03-24 10:39:21.744265","last_fullsized":"2024-03-24 10:39:21.744265","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726445","last_change":"2024-03-24 10:39:21.411540","last_active":"2024-03-24 10:39:21.726445","last_peered":"2024-03-24 10:39:21.726445","last_clean":"2024-03-24 10:39:21.726445","last_became_active":"2024-03-24 10:39:21.410761","last_became_peered":"2024-03-24 10:39:21.410761","last_unstale":"2024-03-24 10:39:21.726445","last_undegraded":"2024-03-24 10:39:21.726445","last_fullsized":"2024-03-24 10:39:21.726445","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744906","last_change":"2024-03-24 10:39:21.736699","last_active":"2024-03-24 10:39:21.744906","last_peered":"2024-03-24 10:39:21.744906","last_clean":"2024-03-24 10:39:21.744906","last_became_active":"2024-03-24 10:39:21.736384","last_became_peered":"2024-03-24 10:39:21.736384","last_unstale":"2024-03-24 10:39:21.744906","last_undegraded":"2024-03-24 10:39:21.744906","last_fullsized":"2024-03-24 10:39:21.744906","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747414","last_change":"2024-03-24 10:39:21.398063","last_active":"2024-03-24 10:39:21.747414","last_peered":"2024-03-24 10:39:21.747414","last_clean":"2024-03-24 10:39:21.747414","last_became_active":"2024-03-24 10:39:21.397278","last_became_peered":"2024-03-24 10:39:21.397278","last_unstale":"2024-03-24 10:39:21.747414","last_undegraded":"2024-03-24 10:39:21.747414","last_fullsized":"2024-03-24 10:39:21.747414","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749692","last_change":"2024-03-24 10:39:21.747336","last_active":"2024-03-24 10:39:21.749692","last_peered":"2024-03-24 10:39:21.749692","last_clean":"2024-03-24 10:39:21.749692","last_became_active":"2024-03-24 10:39:21.746919","last_became_peered":"2024-03-24 10:39:21.746919","last_unstale":"2024-03-24 10:39:21.749692","last_undegraded":"2024-03-24 10:39:21.749692","last_fullsized":"2024-03-24 10:39:21.749692","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725976","last_change":"2024-03-24 10:39:21.404083","last_active":"2024-03-24 10:39:21.725976","last_peered":"2024-03-24 10:39:21.725976","last_clean":"2024-03-24 10:39:21.725976","last_became_active":"2024-03-24 10:39:21.403747","last_became_peered":"2024-03-24 10:39:21.403747","last_unstale":"2024-03-24 10:39:21.725976","last_undegraded":"2024-03-24 10:39:21.725976","last_fullsized":"2024-03-24 10:39:21.725976","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750584","last_change":"2024-03-24 10:39:21.749778","last_active":"2024-03-24 10:39:21.750584","last_peered":"2024-03-24 10:39:21.750584","last_clean":"2024-03-24 10:39:21.750584","last_became_active":"2024-03-24 10:39:21.749344","last_became_peered":"2024-03-24 10:39:21.749344","last_unstale":"2024-03-24 10:39:21.750584","last_undegraded":"2024-03-24 10:39:21.750584","last_fullsized":"2024-03-24 10:39:21.750584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715463","last_change":"2024-03-24 10:39:21.394117","last_active":"2024-03-24 10:39:21.715463","last_peered":"2024-03-24 10:39:21.715463","last_clean":"2024-03-24 10:39:21.715463","last_became_active":"2024-03-24 10:39:21.390303","last_became_peered":"2024-03-24 10:39:21.390303","last_unstale":"2024-03-24 10:39:21.715463","last_undegraded":"2024-03-24 10:39:21.715463","last_fullsized":"2024-03-24 10:39:21.715463","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747294","last_change":"2024-03-24 10:39:21.738700","last_active":"2024-03-24 10:39:21.747294","last_peered":"2024-03-24 10:39:21.747294","last_clean":"2024-03-24 10:39:21.747294","last_became_active":"2024-03-24 10:39:21.738406","last_became_peered":"2024-03-24 10:39:21.738406","last_unstale":"2024-03-24 10:39:21.747294","last_undegraded":"2024-03-24 10:39:21.747294","last_fullsized":"2024-03-24 10:39:21.747294","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744340","last_change":"2024-03-24 10:39:21.392998","last_active":"2024-03-24 10:39:21.744340","last_peered":"2024-03-24 10:39:21.744340","last_clean":"2024-03-24 10:39:21.744340","last_became_active":"2024-03-24 10:39:21.392663","last_became_peered":"2024-03-24 10:39:21.392663","last_unstale":"2024-03-24 10:39:21.744340","last_undegraded":"2024-03-24 10:39:21.744340","last_fullsized":"2024-03-24 10:39:21.744340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749623","last_change":"2024-03-24 10:39:21.748045","last_active":"2024-03-24 10:39:21.749623","last_peered":"2024-03-24 10:39:21.749623","last_clean":"2024-03-24 10:39:21.749623","last_became_active":"2024-03-24 10:39:21.747686","last_became_peered":"2024-03-24 10:39:21.747686","last_unstale":"2024-03-24 10:39:21.749623","last_undegraded":"2024-03-24 10:39:21.749623","last_fullsized":"2024-03-24 10:39:21.749623","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756879","last_change":"2024-03-24 10:39:21.405112","last_active":"2024-03-24 10:39:21.756879","last_peered":"2024-03-24 10:39:21.756879","last_clean":"2024-03-24 10:39:21.756879","last_became_active":"2024-03-24 10:39:21.404792","last_became_peered":"2024-03-24 10:39:21.404792","last_unstale":"2024-03-24 10:39:21.756879","last_undegraded":"2024-03-24 10:39:21.756879","last_fullsized":"2024-03-24 10:39:21.756879","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748245","last_change":"2024-03-24 10:39:21.741272","last_active":"2024-03-24 10:39:21.748245","last_peered":"2024-03-24 10:39:21.748245","last_clean":"2024-03-24 10:39:21.748245","last_became_active":"2024-03-24 10:39:21.740190","last_became_peered":"2024-03-24 10:39:21.740190","last_unstale":"2024-03-24 10:39:21.748245","last_undegraded":"2024-03-24 10:39:21.748245","last_fullsized":"2024-03-24 10:39:21.748245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723769","last_change":"2024-03-24 10:39:21.407652","last_active":"2024-03-24 10:39:21.723769","last_peered":"2024-03-24 10:39:21.723769","last_clean":"2024-03-24 10:39:21.723769","last_became_active":"2024-03-24 10:39:21.407281","last_became_peered":"2024-03-24 10:39:21.407281","last_unstale":"2024-03-24 10:39:21.723769","last_undegraded":"2024-03-24 10:39:21.723769","last_fullsized":"2024-03-24 10:39:21.723769","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744581","last_change":"2024-03-24 10:39:21.734684","last_active":"2024-03-24 10:39:21.744581","last_peered":"2024-03-24 10:39:21.744581","last_clean":"2024-03-24 10:39:21.744581","last_became_active":"2024-03-24 10:39:21.734378","last_became_peered":"2024-03-24 10:39:21.734378","last_unstale":"2024-03-24 10:39:21.744581","last_undegraded":"2024-03-24 10:39:21.744581","last_fullsized":"2024-03-24 10:39:21.744581","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724208","last_change":"2024-03-24 10:39:21.400591","last_active":"2024-03-24 10:39:21.724208","last_peered":"2024-03-24 10:39:21.724208","last_clean":"2024-03-24 10:39:21.724208","last_became_active":"2024-03-24 10:39:21.400291","last_became_peered":"2024-03-24 10:39:21.400291","last_unstale":"2024-03-24 10:39:21.724208","last_undegraded":"2024-03-24 10:39:21.724208","last_fullsized":"2024-03-24 10:39:21.724208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.734103","last_change":"2024-03-24 10:39:21.728699","last_active":"2024-03-24 10:39:21.734103","last_peered":"2024-03-24 10:39:21.734103","last_clean":"2024-03-24 10:39:21.734103","last_became_active":"2024-03-24 10:39:21.728399","last_became_peered":"2024-03-24 10:39:21.728399","last_unstale":"2024-03-24 10:39:21.734103","last_undegraded":"2024-03-24 10:39:21.734103","last_fullsized":"2024-03-24 10:39:21.734103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737300","last_change":"2024-03-24 10:39:21.389698","last_active":"2024-03-24 10:39:21.737300","last_peered":"2024-03-24 10:39:21.737300","last_clean":"2024-03-24 10:39:21.737300","last_became_active":"2024-03-24 10:39:21.389371","last_became_peered":"2024-03-24 10:39:21.389371","last_unstale":"2024-03-24 10:39:21.737300","last_undegraded":"2024-03-24 10:39:21.737300","last_fullsized":"2024-03-24 10:39:21.737300","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745793","last_change":"2024-03-24 10:39:21.736640","last_active":"2024-03-24 10:39:21.745793","last_peered":"2024-03-24 10:39:21.745793","last_clean":"2024-03-24 10:39:21.745793","last_became_active":"2024-03-24 10:39:21.736337","last_became_peered":"2024-03-24 10:39:21.736337","last_unstale":"2024-03-24 10:39:21.745793","last_undegraded":"2024-03-24 10:39:21.745793","last_fullsized":"2024-03-24 10:39:21.745793","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725719","last_change":"2024-03-24 10:39:21.398253","last_active":"2024-03-24 10:39:21.725719","last_peered":"2024-03-24 10:39:21.725719","last_clean":"2024-03-24 10:39:21.725719","last_became_active":"2024-03-24 10:39:21.397537","last_became_peered":"2024-03-24 10:39:21.397537","last_unstale":"2024-03-24 10:39:21.725719","last_undegraded":"2024-03-24 10:39:21.725719","last_fullsized":"2024-03-24 10:39:21.725719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750751","last_change":"2024-03-24 10:39:21.749427","last_active":"2024-03-24 10:39:21.750751","last_peered":"2024-03-24 10:39:21.750751","last_clean":"2024-03-24 10:39:21.750751","last_became_active":"2024-03-24 10:39:21.749070","last_became_peered":"2024-03-24 10:39:21.749070","last_unstale":"2024-03-24 10:39:21.750751","last_undegraded":"2024-03-24 10:39:21.750751","last_fullsized":"2024-03-24 10:39:21.750751","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722365","last_change":"2024-03-24 10:39:21.401943","last_active":"2024-03-24 10:39:21.722365","last_peered":"2024-03-24 10:39:21.722365","last_clean":"2024-03-24 10:39:21.722365","last_became_active":"2024-03-24 10:39:21.396400","last_became_peered":"2024-03-24 10:39:21.396400","last_unstale":"2024-03-24 10:39:21.722365","last_undegraded":"2024-03-24 10:39:21.722365","last_fullsized":"2024-03-24 10:39:21.722365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737949","last_change":"2024-03-24 10:39:21.731745","last_active":"2024-03-24 10:39:21.737949","last_peered":"2024-03-24 10:39:21.737949","last_clean":"2024-03-24 10:39:21.737949","last_became_active":"2024-03-24 10:39:21.731419","last_became_peered":"2024-03-24 10:39:21.731419","last_unstale":"2024-03-24 10:39:21.737949","last_undegraded":"2024-03-24 10:39:21.737949","last_fullsized":"2024-03-24 10:39:21.737949","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750282","last_change":"2024-03-24 10:39:21.390586","last_active":"2024-03-24 10:39:21.750282","last_peered":"2024-03-24 10:39:21.750282","last_clean":"2024-03-24 10:39:21.750282","last_became_active":"2024-03-24 10:39:21.390097","last_became_peered":"2024-03-24 10:39:21.390097","last_unstale":"2024-03-24 10:39:21.750282","last_undegraded":"2024-03-24 10:39:21.750282","last_fullsized":"2024-03-24 10:39:21.750282","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744182","last_change":"2024-03-24 10:39:21.734074","last_active":"2024-03-24 10:39:21.744182","last_peered":"2024-03-24 10:39:21.744182","last_clean":"2024-03-24 10:39:21.744182","last_became_active":"2024-03-24 10:39:21.733775","last_became_peered":"2024-03-24 10:39:21.733775","last_unstale":"2024-03-24 10:39:21.744182","last_undegraded":"2024-03-24 10:39:21.744182","last_fullsized":"2024-03-24 10:39:21.744182","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.746919","last_change":"2024-03-24 10:39:21.403801","last_active":"2024-03-24 10:39:21.746919","last_peered":"2024-03-24 10:39:21.746919","last_clean":"2024-03-24 10:39:21.746919","last_became_active":"2024-03-24 10:39:21.403475","last_became_peered":"2024-03-24 10:39:21.403475","last_unstale":"2024-03-24 10:39:21.746919","last_undegraded":"2024-03-24 10:39:21.746919","last_fullsized":"2024-03-24 10:39:21.746919","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745647","last_change":"2024-03-24 10:39:21.735800","last_active":"2024-03-24 10:39:21.745647","last_peered":"2024-03-24 10:39:21.745647","last_clean":"2024-03-24 10:39:21.745647","last_became_active":"2024-03-24 10:39:21.735499","last_became_peered":"2024-03-24 10:39:21.735499","last_unstale":"2024-03-24 10:39:21.745647","last_undegraded":"2024-03-24 10:39:21.745647","last_fullsized":"2024-03-24 10:39:21.745647","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747151","last_change":"2024-03-24 10:39:21.398511","last_active":"2024-03-24 10:39:21.747151","last_peered":"2024-03-24 10:39:21.747151","last_clean":"2024-03-24 10:39:21.747151","last_became_active":"2024-03-24 10:39:21.397759","last_became_peered":"2024-03-24 10:39:21.397759","last_unstale":"2024-03-24 10:39:21.747151","last_undegraded":"2024-03-24 10:39:21.747151","last_fullsized":"2024-03-24 10:39:21.747151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.754786","last_change":"2024-03-24 10:39:21.750697","last_active":"2024-03-24 10:39:21.754786","last_peered":"2024-03-24 10:39:21.754786","last_clean":"2024-03-24 10:39:21.754786","last_became_active":"2024-03-24 10:39:21.750360","last_became_peered":"2024-03-24 10:39:21.750360","last_unstale":"2024-03-24 10:39:21.754786","last_undegraded":"2024-03-24 10:39:21.754786","last_fullsized":"2024-03-24 10:39:21.754786","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723664","last_change":"2024-03-24 10:39:21.404992","last_active":"2024-03-24 10:39:21.723664","last_peered":"2024-03-24 10:39:21.723664","last_clean":"2024-03-24 10:39:21.723664","last_became_active":"2024-03-24 10:39:21.404656","last_became_peered":"2024-03-24 10:39:21.404656","last_unstale":"2024-03-24 10:39:21.723664","last_undegraded":"2024-03-24 10:39:21.723664","last_fullsized":"2024-03-24 10:39:21.723664","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756515","last_change":"2024-03-24 10:39:21.753684","last_active":"2024-03-24 10:39:21.756515","last_peered":"2024-03-24 10:39:21.756515","last_clean":"2024-03-24 10:39:21.756515","last_became_active":"2024-03-24 10:39:21.753331","last_became_peered":"2024-03-24 10:39:21.753331","last_unstale":"2024-03-24 10:39:21.756515","last_undegraded":"2024-03-24 10:39:21.756515","last_fullsized":"2024-03-24 10:39:21.756515","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.730085","last_change":"2024-03-24 10:39:21.411354","last_active":"2024-03-24 10:39:21.730085","last_peered":"2024-03-24 10:39:21.730085","last_clean":"2024-03-24 10:39:21.730085","last_became_active":"2024-03-24 10:39:21.410898","last_became_peered":"2024-03-24 10:39:21.410898","last_unstale":"2024-03-24 10:39:21.730085","last_undegraded":"2024-03-24 10:39:21.730085","last_fullsized":"2024-03-24 10:39:21.730085","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737268","last_change":"2024-03-24 10:39:21.731852","last_active":"2024-03-24 10:39:21.737268","last_peered":"2024-03-24 10:39:21.737268","last_clean":"2024-03-24 10:39:21.737268","last_became_active":"2024-03-24 10:39:21.731546","last_became_peered":"2024-03-24 10:39:21.731546","last_unstale":"2024-03-24 10:39:21.737268","last_undegraded":"2024-03-24 10:39:21.737268","last_fullsized":"2024-03-24 10:39:21.737268","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748581","last_change":"2024-03-24 10:39:21.395928","last_active":"2024-03-24 10:39:21.748581","last_peered":"2024-03-24 10:39:21.748581","last_clean":"2024-03-24 10:39:21.748581","last_became_active":"2024-03-24 10:39:21.395582","last_became_peered":"2024-03-24 10:39:21.395582","last_unstale":"2024-03-24 10:39:21.748581","last_undegraded":"2024-03-24 10:39:21.748581","last_fullsized":"2024-03-24 10:39:21.748581","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]}]}} 2024-03-24T10:39:25.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-24T10:39:25.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.398 7fb52c4ec700 1 Processor -- start 2024-03-24T10:39:25.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.398 7fb52c4ec700 1 -- start start 2024-03-24T10:39:25.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5241aa7f0 0x7fb5241acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5241a1690 con 0x7fb5240f5a10 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240fa340 con 0x7fb5241aa7f0 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241a18b0 con 0x7fb5241ad280 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46696/0 (socket says 172.21.15.73:46696) 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 -- 172.21.15.73:0/982220329 learned_addr learned my addr 172.21.15.73:0/982220329 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb528ae6700 1 --2- 172.21.15.73:0/982220329 >> v2:172.21.15.73:3300/0 conn(0x7fb5241aa7f0 0x7fb5241acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 -- 172.21.15.73:0/982220329 >> v2:172.21.15.73:3300/0 conn(0x7fb5241aa7f0 msgr2=0x7fb5241acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 --2- 172.21.15.73:0/982220329 >> v2:172.21.15.73:3300/0 conn(0x7fb5241aa7f0 0x7fb5241acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 -- 172.21.15.73:0/982220329 >> v1:172.21.15.73:6789/0 conn(0x7fb5240f5a10 legacy=0x7fb5241a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb517fff700 1 -- 172.21.15.73:0/982220329 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212332384 0 0) 0x7fb520001110 con 0x7fb5240f5a10 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 -- 172.21.15.73:0/982220329 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5241b0d20 con 0x7fb5241ad280 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb529ae8700 1 --2- 172.21.15.73:0/982220329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb5240f4870 tx=0x7fb51c009d90).ready entity=mon.1 client_cookie=b11ccc036ebb8660 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb517fff700 1 -- 172.21.15.73:0/982220329 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5241b0d20 con 0x7fb5241ad280 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb517fff700 1 -- 172.21.15.73:0/982220329 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c00b840 con 0x7fb5241ad280 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb517fff700 1 -- 172.21.15.73:0/982220329 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb51c00ba20 con 0x7fb5241ad280 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 -- 172.21.15.73:0/982220329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 msgr2=0x7fb5241af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.399 7fb52c4ec700 1 --2- 172.21.15.73:0/982220329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb5240f4870 tx=0x7fb51c009d90).stop 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 -- 172.21.15.73:0/982220329 shutdown_connections 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 --2- 172.21.15.73:0/982220329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241ad280 0x7fb5241af6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 --2- 172.21.15.73:0/982220329 >> v2:172.21.15.73:3300/0 conn(0x7fb5241aa7f0 0x7fb5241acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 -- 172.21.15.73:0/982220329 >> 172.21.15.73:0/982220329 conn(0x7fb524113a70 msgr2=0x7fb5240f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 -- 172.21.15.73:0/982220329 shutdown_connections 2024-03-24T10:39:25.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.400 7fb52c4ec700 1 -- 172.21.15.73:0/982220329 wait complete. 2024-03-24T10:39:25.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.422 7fb52c4ec700 1 Processor -- start 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 -- start start 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 0x7fb5240df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb5240df6d0 0x7fb5241bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240e08e0 con 0x7fb5240d70b0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240dfb20 con 0x7fb5241b2bc0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb52c4ec700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240dfd50 con 0x7fb5240df6d0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb528ae6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 0x7fb5240df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb529ae8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb5240df6d0 0x7fb5241bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56228/0 (socket says 172.21.15.73:56228) 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 -- 172.21.15.73:0/1919293270 learned_addr learned my addr 172.21.15.73:0/1919293270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:25.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 -- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb5240df6d0 msgr2=0x7fb5241bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb5240df6d0 0x7fb5241bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 -- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 msgr2=0x7fb5240df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 0x7fb5240df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 -- 172.21.15.73:0/1919293270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5241c0510 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb528ae6700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 0x7fb5240df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.423 7fb5292e7700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb520000bc0 tx=0x7fb52000c810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5241c0510 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520007240 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241c0710 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb520006710 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5241c0af0 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb52001a020 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.424 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb520010c80 con 0x7fb5240d70b0 2024-03-24T10:39:25.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.425 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5240f08e0 con 0x7fb5240d70b0 2024-03-24T10:39:25.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.428 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb520007030 con 0x7fb5240d70b0 2024-03-24T10:39:25.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.566 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb5241b3120 con 0x7fb5240d70b0 2024-03-24T10:39:25.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.567 7fb5167fc700 1 -- 172.21.15.73:0/1919293270 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+32987 (secure 0 0 0) 0x7fb520000c30 con 0x7fb5240d70b0 2024-03-24T10:39:25.568 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:25.568 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","health":{"checks":{},"status":"HEALTH_OK"},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"14","num_mons":3},"osdmap":{"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"num_in_osds":4,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":8}],"num_pgs":136,"num_pools":3,"num_objects":0,"data_bytes":0,"bytes_used":4295426048,"bytes_avail":382251630592,"bytes_total":386547056640,"unknown_pgs_ratio":0.94117647409439087},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4212}],"up:standby":0},"mgrmap":{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6816","nonce":43277}]},"active_addr":"172.21.15.73:6816/43277","active_change":"2024-03-24 10:39:05.106700","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}},"servicemap":{"epoch":1,"modified":"0.000000","services":{}},"progress_events":{}} 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.568 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 >> v1:172.21.15.73:6816/43277 conn(0x7fb50c0145b0 legacy=0x7fb50c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.568 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 msgr2=0x7fb5241b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.568 7fb52c4ec700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb520000bc0 tx=0x7fb52000c810).stop 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 shutdown_connections 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb5240df6d0 0x7fb5241bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5240d70b0 0x7fb5241b2590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 --2- 172.21.15.73:0/1919293270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5241b2bc0 0x7fb5240df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 >> 172.21.15.73:0/1919293270 conn(0x7fb5241a8d80 msgr2=0x7fb5241ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 shutdown_connections 2024-03-24T10:39:25.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.569 7fb52c4ec700 1 -- 172.21.15.73:0/1919293270 wait complete. 2024-03-24T10:39:25.580 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-24T10:39:25.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 Processor -- start 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 -- start start 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 0x7fc4441a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 0x7fc4441a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44410bd60 con 0x7fc4440f5a10 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440fa590 con 0x7fc4441a59d0 2024-03-24T10:39:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc449a8f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441a0c50 con 0x7fc44410b910 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc44305e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 0x7fc4441a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc44205c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 0x7fc4441a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc44285d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc4440f5a10 0x7fc44410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36416/0 (socket says 172.21.15.73:36416) 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.706 7fc44285d700 1 -- 172.21.15.73:0/1707656844 learned_addr learned my addr 172.21.15.73:0/1707656844 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44185b700 1 -- 172.21.15.73:0/1707656844 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742107201 0 0) 0x7fc438001110 con 0x7fc4440f5a10 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44205c700 1 -- 172.21.15.73:0/1707656844 >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 msgr2=0x7fc4441a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44205c700 1 --2- 172.21.15.73:0/1707656844 >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 0x7fc4441a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44205c700 1 -- 172.21.15.73:0/1707656844 >> v1:172.21.15.73:6789/0 conn(0x7fc4440f5a10 legacy=0x7fc44410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44205c700 1 -- 172.21.15.73:0/1707656844 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4441a9470 con 0x7fc44410b910 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44305e700 1 --2- 172.21.15.73:0/1707656844 >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 0x7fc4441a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44205c700 1 --2- 172.21.15.73:0/1707656844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 0x7fc4441a53a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc444103a10 tx=0x7fc43400b9a0).ready entity=mon.2 client_cookie=510bf4ee8bcc322c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44185b700 1 -- 172.21.15.73:0/1707656844 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4441a9470 con 0x7fc44410b910 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44185b700 1 -- 172.21.15.73:0/1707656844 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400d5c0 con 0x7fc44410b910 2024-03-24T10:39:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc44185b700 1 -- 172.21.15.73:0/1707656844 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc43400d990 con 0x7fc44410b910 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc449a8f700 1 -- 172.21.15.73:0/1707656844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 msgr2=0x7fc4441a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.707 7fc449a8f700 1 --2- 172.21.15.73:0/1707656844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 0x7fc4441a53a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc444103a10 tx=0x7fc43400b9a0).stop 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 -- 172.21.15.73:0/1707656844 shutdown_connections 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 --2- 172.21.15.73:0/1707656844 >> v2:172.21.15.73:3300/0 conn(0x7fc4441a59d0 0x7fc4441a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 --2- 172.21.15.73:0/1707656844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc44410b910 0x7fc4441a53a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 -- 172.21.15.73:0/1707656844 >> 172.21.15.73:0/1707656844 conn(0x7fc444113a70 msgr2=0x7fc4440f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 -- 172.21.15.73:0/1707656844 shutdown_connections 2024-03-24T10:39:25.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.708 7fc449a8f700 1 -- 172.21.15.73:0/1707656844 wait complete. 2024-03-24T10:39:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.731 7fc449a8f700 1 Processor -- start 2024-03-24T10:39:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.731 7fc449a8f700 1 -- start start 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 0x7fc4441adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 0x7fc4441b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440f50e0 con 0x7fc4441adb10 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440dcc90 con 0x7fc4441ae590 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc449a8f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440dd2e0 con 0x7fc4441b4c10 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44305e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 0x7fc4441b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46724/0 (socket says 172.21.15.73:46724) 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 -- 172.21.15.73:0/543571859 learned_addr learned my addr 172.21.15.73:0/543571859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44285d700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 0x7fc4441adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 -- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 msgr2=0x7fc4441b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 0x7fc4441b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 -- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 msgr2=0x7fc4441adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 0x7fc4441adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 -- 172.21.15.73:0/543571859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440c3ba0 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44285d700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 0x7fc4441adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44305e700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 0x7fc4441b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.732 7fc44205c700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc4440d5600 tx=0x7fc4340068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc434011860 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc434011a60 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc449a8f700 1 -- 172.21.15.73:0/543571859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4440dcf90 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc43401d450 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc449a8f700 1 -- 172.21.15.73:0/543571859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4441bbd50 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc43401d650 con 0x7fc4441ae590 2024-03-24T10:39:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.733 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc434020120 con 0x7fc4441ae590 2024-03-24T10:39:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.734 7fc449a8f700 1 -- 172.21.15.73:0/543571859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4440f08e0 con 0x7fc4441ae590 2024-03-24T10:39:25.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.737 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc434011650 con 0x7fc4441ae590 2024-03-24T10:39:25.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.839 7fc449a8f700 1 -- 172.21.15.73:0/543571859 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fc4441ae9e0 con 0x7fc4200145b0 2024-03-24T10:39:25.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.846 7fc433fff700 1 -- 172.21.15.73:0/543571859 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306141 (unknown 2965378022 0 614797233) 0x7fc438001580 con 0x7fc4200145b0 2024-03-24T10:39:25.850 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:25.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 >> v1:172.21.15.73:6816/43277 conn(0x7fc4200145b0 legacy=0x7fc420016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 msgr2=0x7fc4441b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc4440d5600 tx=0x7fc4340068c0).stop 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 shutdown_connections 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4441b4c10 0x7fc4441b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441adb10 0x7fc4441adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 --2- 172.21.15.73:0/543571859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4441ae590 0x7fc4441b45e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 >> 172.21.15.73:0/543571859 conn(0x7fc4440c4b20 msgr2=0x7fc4440e06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 shutdown_connections 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:25.849 7fc449a8f700 1 -- 172.21.15.73:0/543571859 wait complete. 2024-03-24T10:39:25.853 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:25.860 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-24 10:39:25.112405","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743122","last_change":"2024-03-24 10:39:21.733062","last_active":"2024-03-24 10:39:21.743122","last_peered":"2024-03-24 10:39:21.743122","last_clean":"2024-03-24 10:39:21.743122","last_became_active":"2024-03-24 10:39:21.732749","last_became_peered":"2024-03-24 10:39:21.732749","last_unstale":"2024-03-24 10:39:21.743122","last_undegraded":"2024-03-24 10:39:21.743122","last_fullsized":"2024-03-24 10:39:21.743122","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723064","last_change":"2024-03-24 10:39:21.410484","last_active":"2024-03-24 10:39:21.723064","last_peered":"2024-03-24 10:39:21.723064","last_clean":"2024-03-24 10:39:21.723064","last_became_active":"2024-03-24 10:39:21.410014","last_became_peered":"2024-03-24 10:39:21.410014","last_unstale":"2024-03-24 10:39:21.723064","last_undegraded":"2024-03-24 10:39:21.723064","last_fullsized":"2024-03-24 10:39:21.723064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756881","last_change":"2024-03-24 10:39:21.754967","last_active":"2024-03-24 10:39:21.756881","last_peered":"2024-03-24 10:39:21.756881","last_clean":"2024-03-24 10:39:21.756881","last_became_active":"2024-03-24 10:39:21.754511","last_became_peered":"2024-03-24 10:39:21.754511","last_unstale":"2024-03-24 10:39:21.756881","last_undegraded":"2024-03-24 10:39:21.756881","last_fullsized":"2024-03-24 10:39:21.756881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722751","last_change":"2024-03-24 10:39:21.405477","last_active":"2024-03-24 10:39:21.722751","last_peered":"2024-03-24 10:39:21.722751","last_clean":"2024-03-24 10:39:21.722751","last_became_active":"2024-03-24 10:39:21.405145","last_became_peered":"2024-03-24 10:39:21.405145","last_unstale":"2024-03-24 10:39:21.722751","last_undegraded":"2024-03-24 10:39:21.722751","last_fullsized":"2024-03-24 10:39:21.722751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750731","last_change":"2024-03-24 10:39:21.749349","last_active":"2024-03-24 10:39:21.750731","last_peered":"2024-03-24 10:39:21.750731","last_clean":"2024-03-24 10:39:21.750731","last_became_active":"2024-03-24 10:39:21.749024","last_became_peered":"2024-03-24 10:39:21.749024","last_unstale":"2024-03-24 10:39:21.750731","last_undegraded":"2024-03-24 10:39:21.750731","last_fullsized":"2024-03-24 10:39:21.750731","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724246","last_change":"2024-03-24 10:39:21.405055","last_active":"2024-03-24 10:39:21.724246","last_peered":"2024-03-24 10:39:21.724246","last_clean":"2024-03-24 10:39:21.724246","last_became_active":"2024-03-24 10:39:21.404748","last_became_peered":"2024-03-24 10:39:21.404748","last_unstale":"2024-03-24 10:39:21.724246","last_undegraded":"2024-03-24 10:39:21.724246","last_fullsized":"2024-03-24 10:39:21.724246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745143","last_change":"2024-03-24 10:39:21.742175","last_active":"2024-03-24 10:39:21.745143","last_peered":"2024-03-24 10:39:21.745143","last_clean":"2024-03-24 10:39:21.745143","last_became_active":"2024-03-24 10:39:21.741904","last_became_peered":"2024-03-24 10:39:21.741904","last_unstale":"2024-03-24 10:39:21.745143","last_undegraded":"2024-03-24 10:39:21.745143","last_fullsized":"2024-03-24 10:39:21.745143","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721675","last_change":"2024-03-24 10:39:21.405185","last_active":"2024-03-24 10:39:21.721675","last_peered":"2024-03-24 10:39:21.721675","last_clean":"2024-03-24 10:39:21.721675","last_became_active":"2024-03-24 10:39:21.404576","last_became_peered":"2024-03-24 10:39:21.404576","last_unstale":"2024-03-24 10:39:21.721675","last_undegraded":"2024-03-24 10:39:21.721675","last_fullsized":"2024-03-24 10:39:21.721675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755187","last_change":"2024-03-24 10:39:21.751864","last_active":"2024-03-24 10:39:21.755187","last_peered":"2024-03-24 10:39:21.755187","last_clean":"2024-03-24 10:39:21.755187","last_became_active":"2024-03-24 10:39:21.751297","last_became_peered":"2024-03-24 10:39:21.751297","last_unstale":"2024-03-24 10:39:21.755187","last_undegraded":"2024-03-24 10:39:21.755187","last_fullsized":"2024-03-24 10:39:21.755187","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724589","last_change":"2024-03-24 10:39:21.393191","last_active":"2024-03-24 10:39:21.724589","last_peered":"2024-03-24 10:39:21.724589","last_clean":"2024-03-24 10:39:21.724589","last_became_active":"2024-03-24 10:39:21.392863","last_became_peered":"2024-03-24 10:39:21.392863","last_unstale":"2024-03-24 10:39:21.724589","last_undegraded":"2024-03-24 10:39:21.724589","last_fullsized":"2024-03-24 10:39:21.724589","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756489","last_change":"2024-03-24 10:39:21.753654","last_active":"2024-03-24 10:39:21.756489","last_peered":"2024-03-24 10:39:21.756489","last_clean":"2024-03-24 10:39:21.756489","last_became_active":"2024-03-24 10:39:21.753306","last_became_peered":"2024-03-24 10:39:21.753306","last_unstale":"2024-03-24 10:39:21.756489","last_undegraded":"2024-03-24 10:39:21.756489","last_fullsized":"2024-03-24 10:39:21.756489","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729807","last_change":"2024-03-24 10:39:21.398093","last_active":"2024-03-24 10:39:21.729807","last_peered":"2024-03-24 10:39:21.729807","last_clean":"2024-03-24 10:39:21.729807","last_became_active":"2024-03-24 10:39:21.397415","last_became_peered":"2024-03-24 10:39:21.397415","last_unstale":"2024-03-24 10:39:21.729807","last_undegraded":"2024-03-24 10:39:21.729807","last_fullsized":"2024-03-24 10:39:21.729807","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748438","last_change":"2024-03-24 10:39:21.746784","last_active":"2024-03-24 10:39:21.748438","last_peered":"2024-03-24 10:39:21.748438","last_clean":"2024-03-24 10:39:21.748438","last_became_active":"2024-03-24 10:39:21.746406","last_became_peered":"2024-03-24 10:39:21.746406","last_unstale":"2024-03-24 10:39:21.748438","last_undegraded":"2024-03-24 10:39:21.748438","last_fullsized":"2024-03-24 10:39:21.748438","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748529","last_change":"2024-03-24 10:39:21.407422","last_active":"2024-03-24 10:39:21.748529","last_peered":"2024-03-24 10:39:21.748529","last_clean":"2024-03-24 10:39:21.748529","last_became_active":"2024-03-24 10:39:21.407030","last_became_peered":"2024-03-24 10:39:21.407030","last_unstale":"2024-03-24 10:39:21.748529","last_undegraded":"2024-03-24 10:39:21.748529","last_fullsized":"2024-03-24 10:39:21.748529","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756688","last_change":"2024-03-24 10:39:21.754359","last_active":"2024-03-24 10:39:21.756688","last_peered":"2024-03-24 10:39:21.756688","last_clean":"2024-03-24 10:39:21.756688","last_became_active":"2024-03-24 10:39:21.754061","last_became_peered":"2024-03-24 10:39:21.754061","last_unstale":"2024-03-24 10:39:21.756688","last_undegraded":"2024-03-24 10:39:21.756688","last_fullsized":"2024-03-24 10:39:21.756688","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750719","last_change":"2024-03-24 10:39:21.389253","last_active":"2024-03-24 10:39:21.750719","last_peered":"2024-03-24 10:39:21.750719","last_clean":"2024-03-24 10:39:21.750719","last_became_active":"2024-03-24 10:39:21.388938","last_became_peered":"2024-03-24 10:39:21.388938","last_unstale":"2024-03-24 10:39:21.750719","last_undegraded":"2024-03-24 10:39:21.750719","last_fullsized":"2024-03-24 10:39:21.750719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748240","last_change":"2024-03-24 10:39:21.743588","last_active":"2024-03-24 10:39:21.748240","last_peered":"2024-03-24 10:39:21.748240","last_clean":"2024-03-24 10:39:21.748240","last_became_active":"2024-03-24 10:39:21.742056","last_became_peered":"2024-03-24 10:39:21.742056","last_unstale":"2024-03-24 10:39:21.748240","last_undegraded":"2024-03-24 10:39:21.748240","last_fullsized":"2024-03-24 10:39:21.748240","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755402","last_change":"2024-03-24 10:39:21.413014","last_active":"2024-03-24 10:39:21.755402","last_peered":"2024-03-24 10:39:21.755402","last_clean":"2024-03-24 10:39:21.755402","last_became_active":"2024-03-24 10:39:21.412716","last_became_peered":"2024-03-24 10:39:21.412716","last_unstale":"2024-03-24 10:39:21.755402","last_undegraded":"2024-03-24 10:39:21.755402","last_fullsized":"2024-03-24 10:39:21.755402","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756575","last_change":"2024-03-24 10:39:21.751937","last_active":"2024-03-24 10:39:21.756575","last_peered":"2024-03-24 10:39:21.756575","last_clean":"2024-03-24 10:39:21.756575","last_became_active":"2024-03-24 10:39:21.751709","last_became_peered":"2024-03-24 10:39:21.751709","last_unstale":"2024-03-24 10:39:21.756575","last_undegraded":"2024-03-24 10:39:21.756575","last_fullsized":"2024-03-24 10:39:21.756575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722537","last_change":"2024-03-24 10:39:21.409360","last_active":"2024-03-24 10:39:21.722537","last_peered":"2024-03-24 10:39:21.722537","last_clean":"2024-03-24 10:39:21.722537","last_became_active":"2024-03-24 10:39:21.409159","last_became_peered":"2024-03-24 10:39:21.409159","last_unstale":"2024-03-24 10:39:21.722537","last_undegraded":"2024-03-24 10:39:21.722537","last_fullsized":"2024-03-24 10:39:21.722537","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743861","last_change":"2024-03-24 10:39:21.733813","last_active":"2024-03-24 10:39:21.743861","last_peered":"2024-03-24 10:39:21.743861","last_clean":"2024-03-24 10:39:21.743861","last_became_active":"2024-03-24 10:39:21.733530","last_became_peered":"2024-03-24 10:39:21.733530","last_unstale":"2024-03-24 10:39:21.743861","last_undegraded":"2024-03-24 10:39:21.743861","last_fullsized":"2024-03-24 10:39:21.743861","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725758","last_change":"2024-03-24 10:39:21.412405","last_active":"2024-03-24 10:39:21.725758","last_peered":"2024-03-24 10:39:21.725758","last_clean":"2024-03-24 10:39:21.725758","last_became_active":"2024-03-24 10:39:21.412066","last_became_peered":"2024-03-24 10:39:21.412066","last_unstale":"2024-03-24 10:39:21.725758","last_undegraded":"2024-03-24 10:39:21.725758","last_fullsized":"2024-03-24 10:39:21.725758","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749646","last_change":"2024-03-24 10:39:21.746871","last_active":"2024-03-24 10:39:21.749646","last_peered":"2024-03-24 10:39:21.749646","last_clean":"2024-03-24 10:39:21.749646","last_became_active":"2024-03-24 10:39:21.746393","last_became_peered":"2024-03-24 10:39:21.746393","last_unstale":"2024-03-24 10:39:21.749646","last_undegraded":"2024-03-24 10:39:21.749646","last_fullsized":"2024-03-24 10:39:21.749646","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745363","last_change":"2024-03-24 10:39:21.386589","last_active":"2024-03-24 10:39:21.745363","last_peered":"2024-03-24 10:39:21.745363","last_clean":"2024-03-24 10:39:21.745363","last_became_active":"2024-03-24 10:39:21.386295","last_became_peered":"2024-03-24 10:39:21.386295","last_unstale":"2024-03-24 10:39:21.745363","last_undegraded":"2024-03-24 10:39:21.745363","last_fullsized":"2024-03-24 10:39:21.745363","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744247","last_change":"2024-03-24 10:39:21.733805","last_active":"2024-03-24 10:39:21.744247","last_peered":"2024-03-24 10:39:21.744247","last_clean":"2024-03-24 10:39:21.744247","last_became_active":"2024-03-24 10:39:21.733501","last_became_peered":"2024-03-24 10:39:21.733501","last_unstale":"2024-03-24 10:39:21.744247","last_undegraded":"2024-03-24 10:39:21.744247","last_fullsized":"2024-03-24 10:39:21.744247","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747691","last_change":"2024-03-24 10:39:21.398400","last_active":"2024-03-24 10:39:21.747691","last_peered":"2024-03-24 10:39:21.747691","last_clean":"2024-03-24 10:39:21.747691","last_became_active":"2024-03-24 10:39:21.397859","last_became_peered":"2024-03-24 10:39:21.397859","last_unstale":"2024-03-24 10:39:21.747691","last_undegraded":"2024-03-24 10:39:21.747691","last_fullsized":"2024-03-24 10:39:21.747691","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747817","last_change":"2024-03-24 10:39:21.741686","last_active":"2024-03-24 10:39:21.747817","last_peered":"2024-03-24 10:39:21.747817","last_clean":"2024-03-24 10:39:21.747817","last_became_active":"2024-03-24 10:39:21.741119","last_became_peered":"2024-03-24 10:39:21.741119","last_unstale":"2024-03-24 10:39:21.747817","last_undegraded":"2024-03-24 10:39:21.747817","last_fullsized":"2024-03-24 10:39:21.747817","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752068","last_change":"2024-03-24 10:39:21.389678","last_active":"2024-03-24 10:39:21.752068","last_peered":"2024-03-24 10:39:21.752068","last_clean":"2024-03-24 10:39:21.752068","last_became_active":"2024-03-24 10:39:21.389377","last_became_peered":"2024-03-24 10:39:21.389377","last_unstale":"2024-03-24 10:39:21.752068","last_undegraded":"2024-03-24 10:39:21.752068","last_fullsized":"2024-03-24 10:39:21.752068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748099","last_change":"2024-03-24 10:39:21.742841","last_active":"2024-03-24 10:39:21.748099","last_peered":"2024-03-24 10:39:21.748099","last_clean":"2024-03-24 10:39:21.748099","last_became_active":"2024-03-24 10:39:21.742567","last_became_peered":"2024-03-24 10:39:21.742567","last_unstale":"2024-03-24 10:39:21.748099","last_undegraded":"2024-03-24 10:39:21.748099","last_fullsized":"2024-03-24 10:39:21.748099","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722471","last_change":"2024-03-24 10:39:21.407601","last_active":"2024-03-24 10:39:21.722471","last_peered":"2024-03-24 10:39:21.722471","last_clean":"2024-03-24 10:39:21.722471","last_became_active":"2024-03-24 10:39:21.407123","last_became_peered":"2024-03-24 10:39:21.407123","last_unstale":"2024-03-24 10:39:21.722471","last_undegraded":"2024-03-24 10:39:21.722471","last_fullsized":"2024-03-24 10:39:21.722471","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747918","last_change":"2024-03-24 10:39:21.741427","last_active":"2024-03-24 10:39:21.747918","last_peered":"2024-03-24 10:39:21.747918","last_clean":"2024-03-24 10:39:21.747918","last_became_active":"2024-03-24 10:39:21.741202","last_became_peered":"2024-03-24 10:39:21.741202","last_unstale":"2024-03-24 10:39:21.747918","last_undegraded":"2024-03-24 10:39:21.747918","last_fullsized":"2024-03-24 10:39:21.747918","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716544","last_change":"2024-03-24 10:39:21.397164","last_active":"2024-03-24 10:39:21.716544","last_peered":"2024-03-24 10:39:21.716544","last_clean":"2024-03-24 10:39:21.716544","last_became_active":"2024-03-24 10:39:21.396867","last_became_peered":"2024-03-24 10:39:21.396867","last_unstale":"2024-03-24 10:39:21.716544","last_undegraded":"2024-03-24 10:39:21.716544","last_fullsized":"2024-03-24 10:39:21.716544","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747260","last_change":"2024-03-24 10:39:21.740995","last_active":"2024-03-24 10:39:21.747260","last_peered":"2024-03-24 10:39:21.747260","last_clean":"2024-03-24 10:39:21.747260","last_became_active":"2024-03-24 10:39:21.740697","last_became_peered":"2024-03-24 10:39:21.740697","last_unstale":"2024-03-24 10:39:21.747260","last_undegraded":"2024-03-24 10:39:21.747260","last_fullsized":"2024-03-24 10:39:21.747260","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749980","last_change":"2024-03-24 10:39:21.411252","last_active":"2024-03-24 10:39:21.749980","last_peered":"2024-03-24 10:39:21.749980","last_clean":"2024-03-24 10:39:21.749980","last_became_active":"2024-03-24 10:39:21.410965","last_became_peered":"2024-03-24 10:39:21.410965","last_unstale":"2024-03-24 10:39:21.749980","last_undegraded":"2024-03-24 10:39:21.749980","last_fullsized":"2024-03-24 10:39:21.749980","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750603","last_change":"2024-03-24 10:39:21.749883","last_active":"2024-03-24 10:39:21.750603","last_peered":"2024-03-24 10:39:21.750603","last_clean":"2024-03-24 10:39:21.750603","last_became_active":"2024-03-24 10:39:21.749521","last_became_peered":"2024-03-24 10:39:21.749521","last_unstale":"2024-03-24 10:39:21.750603","last_undegraded":"2024-03-24 10:39:21.750603","last_fullsized":"2024-03-24 10:39:21.750603","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725159","last_change":"2024-03-24 10:39:21.396016","last_active":"2024-03-24 10:39:21.725159","last_peered":"2024-03-24 10:39:21.725159","last_clean":"2024-03-24 10:39:21.725159","last_became_active":"2024-03-24 10:39:21.395496","last_became_peered":"2024-03-24 10:39:21.395496","last_unstale":"2024-03-24 10:39:21.725159","last_undegraded":"2024-03-24 10:39:21.725159","last_fullsized":"2024-03-24 10:39:21.725159","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748341","last_change":"2024-03-24 10:39:21.741529","last_active":"2024-03-24 10:39:21.748341","last_peered":"2024-03-24 10:39:21.748341","last_clean":"2024-03-24 10:39:21.748341","last_became_active":"2024-03-24 10:39:21.741235","last_became_peered":"2024-03-24 10:39:21.741235","last_unstale":"2024-03-24 10:39:21.748341","last_undegraded":"2024-03-24 10:39:21.748341","last_fullsized":"2024-03-24 10:39:21.748341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.719089","last_change":"2024-03-24 10:39:21.401865","last_active":"2024-03-24 10:39:21.719089","last_peered":"2024-03-24 10:39:21.719089","last_clean":"2024-03-24 10:39:21.719089","last_became_active":"2024-03-24 10:39:21.401590","last_became_peered":"2024-03-24 10:39:21.401590","last_unstale":"2024-03-24 10:39:21.719089","last_undegraded":"2024-03-24 10:39:21.719089","last_fullsized":"2024-03-24 10:39:21.719089","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749696","last_change":"2024-03-24 10:39:21.747518","last_active":"2024-03-24 10:39:21.749696","last_peered":"2024-03-24 10:39:21.749696","last_clean":"2024-03-24 10:39:21.749696","last_became_active":"2024-03-24 10:39:21.746543","last_became_peered":"2024-03-24 10:39:21.746543","last_unstale":"2024-03-24 10:39:21.749696","last_undegraded":"2024-03-24 10:39:21.749696","last_fullsized":"2024-03-24 10:39:21.749696","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723834","last_change":"2024-03-24 10:39:21.398690","last_active":"2024-03-24 10:39:21.723834","last_peered":"2024-03-24 10:39:21.723834","last_clean":"2024-03-24 10:39:21.723834","last_became_active":"2024-03-24 10:39:21.398369","last_became_peered":"2024-03-24 10:39:21.398369","last_unstale":"2024-03-24 10:39:21.723834","last_undegraded":"2024-03-24 10:39:21.723834","last_fullsized":"2024-03-24 10:39:21.723834","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748298","last_change":"2024-03-24 10:39:21.745829","last_active":"2024-03-24 10:39:21.748298","last_peered":"2024-03-24 10:39:21.748298","last_clean":"2024-03-24 10:39:21.748298","last_became_active":"2024-03-24 10:39:21.745472","last_became_peered":"2024-03-24 10:39:21.745472","last_unstale":"2024-03-24 10:39:21.748298","last_undegraded":"2024-03-24 10:39:21.748298","last_fullsized":"2024-03-24 10:39:21.748298","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718093","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:21.718093","last_peered":"2024-03-24 10:39:21.718093","last_clean":"2024-03-24 10:39:21.718093","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:21.718093","last_undegraded":"2024-03-24 10:39:21.718093","last_fullsized":"2024-03-24 10:39:21.718093","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724305","last_change":"2024-03-24 10:39:21.400473","last_active":"2024-03-24 10:39:21.724305","last_peered":"2024-03-24 10:39:21.724305","last_clean":"2024-03-24 10:39:21.724305","last_became_active":"2024-03-24 10:39:21.400199","last_became_peered":"2024-03-24 10:39:21.400199","last_unstale":"2024-03-24 10:39:21.724305","last_undegraded":"2024-03-24 10:39:21.724305","last_fullsized":"2024-03-24 10:39:21.724305","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748222","last_change":"2024-03-24 10:39:21.743515","last_active":"2024-03-24 10:39:21.748222","last_peered":"2024-03-24 10:39:21.748222","last_clean":"2024-03-24 10:39:21.748222","last_became_active":"2024-03-24 10:39:21.740628","last_became_peered":"2024-03-24 10:39:21.740628","last_unstale":"2024-03-24 10:39:21.748222","last_undegraded":"2024-03-24 10:39:21.748222","last_fullsized":"2024-03-24 10:39:21.748222","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726669","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:21.726669","last_peered":"2024-03-24 10:39:21.726669","last_clean":"2024-03-24 10:39:21.726669","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:21.726669","last_undegraded":"2024-03-24 10:39:21.726669","last_fullsized":"2024-03-24 10:39:21.726669","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751900","last_change":"2024-03-24 10:39:21.410337","last_active":"2024-03-24 10:39:21.751900","last_peered":"2024-03-24 10:39:21.751900","last_clean":"2024-03-24 10:39:21.751900","last_became_active":"2024-03-24 10:39:21.410037","last_became_peered":"2024-03-24 10:39:21.410037","last_unstale":"2024-03-24 10:39:21.751900","last_undegraded":"2024-03-24 10:39:21.751900","last_fullsized":"2024-03-24 10:39:21.751900","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722808","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:21.722808","last_peered":"2024-03-24 10:39:21.722808","last_clean":"2024-03-24 10:39:21.722808","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:21.722808","last_undegraded":"2024-03-24 10:39:21.722808","last_fullsized":"2024-03-24 10:39:21.722808","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721775","last_change":"2024-03-24 10:39:21.405373","last_active":"2024-03-24 10:39:21.721775","last_peered":"2024-03-24 10:39:21.721775","last_clean":"2024-03-24 10:39:21.721775","last_became_active":"2024-03-24 10:39:21.404592","last_became_peered":"2024-03-24 10:39:21.404592","last_unstale":"2024-03-24 10:39:21.721775","last_undegraded":"2024-03-24 10:39:21.721775","last_fullsized":"2024-03-24 10:39:21.721775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745772","last_change":"2024-03-24 10:39:21.736241","last_active":"2024-03-24 10:39:21.745772","last_peered":"2024-03-24 10:39:21.745772","last_clean":"2024-03-24 10:39:21.745772","last_became_active":"2024-03-24 10:39:21.732484","last_became_peered":"2024-03-24 10:39:21.732484","last_unstale":"2024-03-24 10:39:21.745772","last_undegraded":"2024-03-24 10:39:21.745772","last_fullsized":"2024-03-24 10:39:21.745772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726569","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:21.726569","last_peered":"2024-03-24 10:39:21.726569","last_clean":"2024-03-24 10:39:21.726569","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:21.726569","last_undegraded":"2024-03-24 10:39:21.726569","last_fullsized":"2024-03-24 10:39:21.726569","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715418","last_change":"2024-03-24 10:39:21.386180","last_active":"2024-03-24 10:39:21.715418","last_peered":"2024-03-24 10:39:21.715418","last_clean":"2024-03-24 10:39:21.715418","last_became_active":"2024-03-24 10:39:21.385860","last_became_peered":"2024-03-24 10:39:21.385860","last_unstale":"2024-03-24 10:39:21.715418","last_undegraded":"2024-03-24 10:39:21.715418","last_fullsized":"2024-03-24 10:39:21.715418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743840","last_change":"2024-03-24 10:39:21.733305","last_active":"2024-03-24 10:39:21.743840","last_peered":"2024-03-24 10:39:21.743840","last_clean":"2024-03-24 10:39:21.743840","last_became_active":"2024-03-24 10:39:21.732991","last_became_peered":"2024-03-24 10:39:21.732991","last_unstale":"2024-03-24 10:39:21.743840","last_undegraded":"2024-03-24 10:39:21.743840","last_fullsized":"2024-03-24 10:39:21.743840","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.720076","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:21.720076","last_peered":"2024-03-24 10:39:21.720076","last_clean":"2024-03-24 10:39:21.720076","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:21.720076","last_undegraded":"2024-03-24 10:39:21.720076","last_fullsized":"2024-03-24 10:39:21.720076","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722676","last_change":"2024-03-24 10:39:21.410670","last_active":"2024-03-24 10:39:21.722676","last_peered":"2024-03-24 10:39:21.722676","last_clean":"2024-03-24 10:39:21.722676","last_became_active":"2024-03-24 10:39:21.410239","last_became_peered":"2024-03-24 10:39:21.410239","last_unstale":"2024-03-24 10:39:21.722676","last_undegraded":"2024-03-24 10:39:21.722676","last_fullsized":"2024-03-24 10:39:21.722676","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744919","last_change":"2024-03-24 10:39:21.734952","last_active":"2024-03-24 10:39:21.744919","last_peered":"2024-03-24 10:39:21.744919","last_clean":"2024-03-24 10:39:21.744919","last_became_active":"2024-03-24 10:39:21.734666","last_became_peered":"2024-03-24 10:39:21.734666","last_unstale":"2024-03-24 10:39:21.744919","last_undegraded":"2024-03-24 10:39:21.744919","last_fullsized":"2024-03-24 10:39:21.744919","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724151","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:21.724151","last_peered":"2024-03-24 10:39:21.724151","last_clean":"2024-03-24 10:39:21.724151","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:21.724151","last_undegraded":"2024-03-24 10:39:21.724151","last_fullsized":"2024-03-24 10:39:21.724151","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722647","last_change":"2024-03-24 10:39:21.406436","last_active":"2024-03-24 10:39:21.722647","last_peered":"2024-03-24 10:39:21.722647","last_clean":"2024-03-24 10:39:21.722647","last_became_active":"2024-03-24 10:39:21.406101","last_became_peered":"2024-03-24 10:39:21.406101","last_unstale":"2024-03-24 10:39:21.722647","last_undegraded":"2024-03-24 10:39:21.722647","last_fullsized":"2024-03-24 10:39:21.722647","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737910","last_change":"2024-03-24 10:39:21.731561","last_active":"2024-03-24 10:39:21.737910","last_peered":"2024-03-24 10:39:21.737910","last_clean":"2024-03-24 10:39:21.737910","last_became_active":"2024-03-24 10:39:21.730998","last_became_peered":"2024-03-24 10:39:21.730998","last_unstale":"2024-03-24 10:39:21.737910","last_undegraded":"2024-03-24 10:39:21.737910","last_fullsized":"2024-03-24 10:39:21.737910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.727104","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:21.727104","last_peered":"2024-03-24 10:39:21.727104","last_clean":"2024-03-24 10:39:21.727104","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:21.727104","last_undegraded":"2024-03-24 10:39:21.727104","last_fullsized":"2024-03-24 10:39:21.727104","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726454","last_change":"2024-03-24 10:39:21.407528","last_active":"2024-03-24 10:39:21.726454","last_peered":"2024-03-24 10:39:21.726454","last_clean":"2024-03-24 10:39:21.726454","last_became_active":"2024-03-24 10:39:21.407090","last_became_peered":"2024-03-24 10:39:21.407090","last_unstale":"2024-03-24 10:39:21.726454","last_undegraded":"2024-03-24 10:39:21.726454","last_fullsized":"2024-03-24 10:39:21.726454","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745252","last_change":"2024-03-24 10:39:21.737964","last_active":"2024-03-24 10:39:21.745252","last_peered":"2024-03-24 10:39:21.745252","last_clean":"2024-03-24 10:39:21.745252","last_became_active":"2024-03-24 10:39:21.736699","last_became_peered":"2024-03-24 10:39:21.736699","last_unstale":"2024-03-24 10:39:21.745252","last_undegraded":"2024-03-24 10:39:21.745252","last_fullsized":"2024-03-24 10:39:21.745252","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724662","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:21.724662","last_peered":"2024-03-24 10:39:21.724662","last_clean":"2024-03-24 10:39:21.724662","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:21.724662","last_undegraded":"2024-03-24 10:39:21.724662","last_fullsized":"2024-03-24 10:39:21.724662","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723118","last_change":"2024-03-24 10:39:21.402542","last_active":"2024-03-24 10:39:21.723118","last_peered":"2024-03-24 10:39:21.723118","last_clean":"2024-03-24 10:39:21.723118","last_became_active":"2024-03-24 10:39:21.402228","last_became_peered":"2024-03-24 10:39:21.402228","last_unstale":"2024-03-24 10:39:21.723118","last_undegraded":"2024-03-24 10:39:21.723118","last_fullsized":"2024-03-24 10:39:21.723118","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738540","last_change":"2024-03-24 10:39:21.730414","last_active":"2024-03-24 10:39:21.738540","last_peered":"2024-03-24 10:39:21.738540","last_clean":"2024-03-24 10:39:21.738540","last_became_active":"2024-03-24 10:39:21.730157","last_became_peered":"2024-03-24 10:39:21.730157","last_unstale":"2024-03-24 10:39:21.738540","last_undegraded":"2024-03-24 10:39:21.738540","last_fullsized":"2024-03-24 10:39:21.738540","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756740","last_change":"2024-03-24 10:39:21.753593","last_active":"2024-03-24 10:39:21.756740","last_peered":"2024-03-24 10:39:21.756740","last_clean":"2024-03-24 10:39:21.756740","last_became_active":"2024-03-24 10:39:21.753209","last_became_peered":"2024-03-24 10:39:21.753209","last_unstale":"2024-03-24 10:39:21.756740","last_undegraded":"2024-03-24 10:39:21.756740","last_fullsized":"2024-03-24 10:39:21.756740","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729205","last_change":"2024-03-24 10:39:21.403995","last_active":"2024-03-24 10:39:21.729205","last_peered":"2024-03-24 10:39:21.729205","last_clean":"2024-03-24 10:39:21.729205","last_became_active":"2024-03-24 10:39:21.403652","last_became_peered":"2024-03-24 10:39:21.403652","last_unstale":"2024-03-24 10:39:21.729205","last_undegraded":"2024-03-24 10:39:21.729205","last_fullsized":"2024-03-24 10:39:21.729205","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745272","last_change":"2024-03-24 10:39:21.738871","last_active":"2024-03-24 10:39:21.745272","last_peered":"2024-03-24 10:39:21.745272","last_clean":"2024-03-24 10:39:21.745272","last_became_active":"2024-03-24 10:39:21.738567","last_became_peered":"2024-03-24 10:39:21.738567","last_unstale":"2024-03-24 10:39:21.745272","last_undegraded":"2024-03-24 10:39:21.745272","last_fullsized":"2024-03-24 10:39:21.745272","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748037","last_change":"2024-03-24 10:39:21.402898","last_active":"2024-03-24 10:39:21.748037","last_peered":"2024-03-24 10:39:21.748037","last_clean":"2024-03-24 10:39:21.748037","last_became_active":"2024-03-24 10:39:21.402655","last_became_peered":"2024-03-24 10:39:21.402655","last_unstale":"2024-03-24 10:39:21.748037","last_undegraded":"2024-03-24 10:39:21.748037","last_fullsized":"2024-03-24 10:39:21.748037","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747775","last_change":"2024-03-24 10:39:21.741510","last_active":"2024-03-24 10:39:21.747775","last_peered":"2024-03-24 10:39:21.747775","last_clean":"2024-03-24 10:39:21.747775","last_became_active":"2024-03-24 10:39:21.740907","last_became_peered":"2024-03-24 10:39:21.740907","last_unstale":"2024-03-24 10:39:21.747775","last_undegraded":"2024-03-24 10:39:21.747775","last_fullsized":"2024-03-24 10:39:21.747775","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752967","last_change":"2024-03-24 10:39:21.406729","last_active":"2024-03-24 10:39:21.752967","last_peered":"2024-03-24 10:39:21.752967","last_clean":"2024-03-24 10:39:21.752967","last_became_active":"2024-03-24 10:39:21.406428","last_became_peered":"2024-03-24 10:39:21.406428","last_unstale":"2024-03-24 10:39:21.752967","last_undegraded":"2024-03-24 10:39:21.752967","last_fullsized":"2024-03-24 10:39:21.752967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751571","last_change":"2024-03-24 10:39:21.750478","last_active":"2024-03-24 10:39:21.751571","last_peered":"2024-03-24 10:39:21.751571","last_clean":"2024-03-24 10:39:21.751571","last_became_active":"2024-03-24 10:39:21.750180","last_became_peered":"2024-03-24 10:39:21.750180","last_unstale":"2024-03-24 10:39:21.751571","last_undegraded":"2024-03-24 10:39:21.751571","last_fullsized":"2024-03-24 10:39:21.751571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.753802","last_change":"2024-03-24 10:39:21.411578","last_active":"2024-03-24 10:39:21.753802","last_peered":"2024-03-24 10:39:21.753802","last_clean":"2024-03-24 10:39:21.753802","last_became_active":"2024-03-24 10:39:21.410949","last_became_peered":"2024-03-24 10:39:21.410949","last_unstale":"2024-03-24 10:39:21.753802","last_undegraded":"2024-03-24 10:39:21.753802","last_fullsized":"2024-03-24 10:39:21.753802","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738381","last_change":"2024-03-24 10:39:21.729490","last_active":"2024-03-24 10:39:21.738381","last_peered":"2024-03-24 10:39:21.738381","last_clean":"2024-03-24 10:39:21.738381","last_became_active":"2024-03-24 10:39:21.729213","last_became_peered":"2024-03-24 10:39:21.729213","last_unstale":"2024-03-24 10:39:21.738381","last_undegraded":"2024-03-24 10:39:21.738381","last_fullsized":"2024-03-24 10:39:21.738381","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722050","last_change":"2024-03-24 10:39:21.405449","last_active":"2024-03-24 10:39:21.722050","last_peered":"2024-03-24 10:39:21.722050","last_clean":"2024-03-24 10:39:21.722050","last_became_active":"2024-03-24 10:39:21.404858","last_became_peered":"2024-03-24 10:39:21.404858","last_unstale":"2024-03-24 10:39:21.722050","last_undegraded":"2024-03-24 10:39:21.722050","last_fullsized":"2024-03-24 10:39:21.722050","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744150","last_change":"2024-03-24 10:39:21.734494","last_active":"2024-03-24 10:39:21.744150","last_peered":"2024-03-24 10:39:21.744150","last_clean":"2024-03-24 10:39:21.744150","last_became_active":"2024-03-24 10:39:21.734226","last_became_peered":"2024-03-24 10:39:21.734226","last_unstale":"2024-03-24 10:39:21.744150","last_undegraded":"2024-03-24 10:39:21.744150","last_fullsized":"2024-03-24 10:39:21.744150","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715521","last_change":"2024-03-24 10:39:21.393879","last_active":"2024-03-24 10:39:21.715521","last_peered":"2024-03-24 10:39:21.715521","last_clean":"2024-03-24 10:39:21.715521","last_became_active":"2024-03-24 10:39:21.393571","last_became_peered":"2024-03-24 10:39:21.393571","last_unstale":"2024-03-24 10:39:21.715521","last_undegraded":"2024-03-24 10:39:21.715521","last_fullsized":"2024-03-24 10:39:21.715521","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756857","last_change":"2024-03-24 10:39:21.754801","last_active":"2024-03-24 10:39:21.756857","last_peered":"2024-03-24 10:39:21.756857","last_clean":"2024-03-24 10:39:21.756857","last_became_active":"2024-03-24 10:39:21.754290","last_became_peered":"2024-03-24 10:39:21.754290","last_unstale":"2024-03-24 10:39:21.756857","last_undegraded":"2024-03-24 10:39:21.756857","last_fullsized":"2024-03-24 10:39:21.756857","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722857","last_change":"2024-03-24 10:39:21.413325","last_active":"2024-03-24 10:39:21.722857","last_peered":"2024-03-24 10:39:21.722857","last_clean":"2024-03-24 10:39:21.722857","last_became_active":"2024-03-24 10:39:21.412968","last_became_peered":"2024-03-24 10:39:21.412968","last_unstale":"2024-03-24 10:39:21.722857","last_undegraded":"2024-03-24 10:39:21.722857","last_fullsized":"2024-03-24 10:39:21.722857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750074","last_change":"2024-03-24 10:39:21.749344","last_active":"2024-03-24 10:39:21.750074","last_peered":"2024-03-24 10:39:21.750074","last_clean":"2024-03-24 10:39:21.750074","last_became_active":"2024-03-24 10:39:21.748994","last_became_peered":"2024-03-24 10:39:21.748994","last_unstale":"2024-03-24 10:39:21.750074","last_undegraded":"2024-03-24 10:39:21.750074","last_fullsized":"2024-03-24 10:39:21.750074","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723365","last_change":"2024-03-24 10:39:21.406440","last_active":"2024-03-24 10:39:21.723365","last_peered":"2024-03-24 10:39:21.723365","last_clean":"2024-03-24 10:39:21.723365","last_became_active":"2024-03-24 10:39:21.406223","last_became_peered":"2024-03-24 10:39:21.406223","last_unstale":"2024-03-24 10:39:21.723365","last_undegraded":"2024-03-24 10:39:21.723365","last_fullsized":"2024-03-24 10:39:21.723365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744941","last_change":"2024-03-24 10:39:21.735015","last_active":"2024-03-24 10:39:21.744941","last_peered":"2024-03-24 10:39:21.744941","last_clean":"2024-03-24 10:39:21.744941","last_became_active":"2024-03-24 10:39:21.734736","last_became_peered":"2024-03-24 10:39:21.734736","last_unstale":"2024-03-24 10:39:21.744941","last_undegraded":"2024-03-24 10:39:21.744941","last_fullsized":"2024-03-24 10:39:21.744941","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723220","last_change":"2024-03-24 10:39:21.402419","last_active":"2024-03-24 10:39:21.723220","last_peered":"2024-03-24 10:39:21.723220","last_clean":"2024-03-24 10:39:21.723220","last_became_active":"2024-03-24 10:39:21.402129","last_became_peered":"2024-03-24 10:39:21.402129","last_unstale":"2024-03-24 10:39:21.723220","last_undegraded":"2024-03-24 10:39:21.723220","last_fullsized":"2024-03-24 10:39:21.723220","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756584","last_change":"2024-03-24 10:39:21.752207","last_active":"2024-03-24 10:39:21.756584","last_peered":"2024-03-24 10:39:21.756584","last_clean":"2024-03-24 10:39:21.756584","last_became_active":"2024-03-24 10:39:21.751891","last_became_peered":"2024-03-24 10:39:21.751891","last_unstale":"2024-03-24 10:39:21.756584","last_undegraded":"2024-03-24 10:39:21.756584","last_fullsized":"2024-03-24 10:39:21.756584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718129","last_change":"2024-03-24 10:39:21.396998","last_active":"2024-03-24 10:39:21.718129","last_peered":"2024-03-24 10:39:21.718129","last_clean":"2024-03-24 10:39:21.718129","last_became_active":"2024-03-24 10:39:21.396640","last_became_peered":"2024-03-24 10:39:21.396640","last_unstale":"2024-03-24 10:39:21.718129","last_undegraded":"2024-03-24 10:39:21.718129","last_fullsized":"2024-03-24 10:39:21.718129","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750006","last_change":"2024-03-24 10:39:21.747974","last_active":"2024-03-24 10:39:21.750006","last_peered":"2024-03-24 10:39:21.750006","last_clean":"2024-03-24 10:39:21.750006","last_became_active":"2024-03-24 10:39:21.742188","last_became_peered":"2024-03-24 10:39:21.742188","last_unstale":"2024-03-24 10:39:21.750006","last_undegraded":"2024-03-24 10:39:21.750006","last_fullsized":"2024-03-24 10:39:21.750006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-03-24 10:39:23.028062","last_change":"2024-03-24 10:39:21.412507","last_active":"2024-03-24 10:39:23.028062","last_peered":"2024-03-24 10:39:23.028062","last_clean":"2024-03-24 10:39:23.028062","last_became_active":"2024-03-24 10:39:21.412194","last_became_peered":"2024-03-24 10:39:21.412194","last_unstale":"2024-03-24 10:39:23.028062","last_undegraded":"2024-03-24 10:39:23.028062","last_fullsized":"2024-03-24 10:39:23.028062","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755163","last_change":"2024-03-24 10:39:21.751687","last_active":"2024-03-24 10:39:21.755163","last_peered":"2024-03-24 10:39:21.755163","last_clean":"2024-03-24 10:39:21.755163","last_became_active":"2024-03-24 10:39:21.751067","last_became_peered":"2024-03-24 10:39:21.751067","last_unstale":"2024-03-24 10:39:21.755163","last_undegraded":"2024-03-24 10:39:21.755163","last_fullsized":"2024-03-24 10:39:21.755163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726350","last_change":"2024-03-24 10:39:21.409431","last_active":"2024-03-24 10:39:21.726350","last_peered":"2024-03-24 10:39:21.726350","last_clean":"2024-03-24 10:39:21.726350","last_became_active":"2024-03-24 10:39:21.409077","last_became_peered":"2024-03-24 10:39:21.409077","last_unstale":"2024-03-24 10:39:21.726350","last_undegraded":"2024-03-24 10:39:21.726350","last_fullsized":"2024-03-24 10:39:21.726350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748566","last_change":"2024-03-24 10:39:21.746704","last_active":"2024-03-24 10:39:21.748566","last_peered":"2024-03-24 10:39:21.748566","last_clean":"2024-03-24 10:39:21.748566","last_became_active":"2024-03-24 10:39:21.746288","last_became_peered":"2024-03-24 10:39:21.746288","last_unstale":"2024-03-24 10:39:21.748566","last_undegraded":"2024-03-24 10:39:21.748566","last_fullsized":"2024-03-24 10:39:21.748566","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722735","last_change":"2024-03-24 10:39:21.405622","last_active":"2024-03-24 10:39:21.722735","last_peered":"2024-03-24 10:39:21.722735","last_clean":"2024-03-24 10:39:21.722735","last_became_active":"2024-03-24 10:39:21.405031","last_became_peered":"2024-03-24 10:39:21.405031","last_unstale":"2024-03-24 10:39:21.722735","last_undegraded":"2024-03-24 10:39:21.722735","last_fullsized":"2024-03-24 10:39:21.722735","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749673","last_change":"2024-03-24 10:39:21.747203","last_active":"2024-03-24 10:39:21.749673","last_peered":"2024-03-24 10:39:21.749673","last_clean":"2024-03-24 10:39:21.749673","last_became_active":"2024-03-24 10:39:21.746669","last_became_peered":"2024-03-24 10:39:21.746669","last_unstale":"2024-03-24 10:39:21.749673","last_undegraded":"2024-03-24 10:39:21.749673","last_fullsized":"2024-03-24 10:39:21.749673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722465","last_change":"2024-03-24 10:39:21.401363","last_active":"2024-03-24 10:39:21.722465","last_peered":"2024-03-24 10:39:21.722465","last_clean":"2024-03-24 10:39:21.722465","last_became_active":"2024-03-24 10:39:21.401068","last_became_peered":"2024-03-24 10:39:21.401068","last_unstale":"2024-03-24 10:39:21.722465","last_undegraded":"2024-03-24 10:39:21.722465","last_fullsized":"2024-03-24 10:39:21.722465","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737930","last_change":"2024-03-24 10:39:21.731704","last_active":"2024-03-24 10:39:21.737930","last_peered":"2024-03-24 10:39:21.737930","last_clean":"2024-03-24 10:39:21.737930","last_became_active":"2024-03-24 10:39:21.731209","last_became_peered":"2024-03-24 10:39:21.731209","last_unstale":"2024-03-24 10:39:21.737930","last_undegraded":"2024-03-24 10:39:21.737930","last_fullsized":"2024-03-24 10:39:21.737930","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725064","last_change":"2024-03-24 10:39:21.396241","last_active":"2024-03-24 10:39:21.725064","last_peered":"2024-03-24 10:39:21.725064","last_clean":"2024-03-24 10:39:21.725064","last_became_active":"2024-03-24 10:39:21.395775","last_became_peered":"2024-03-24 10:39:21.395775","last_unstale":"2024-03-24 10:39:21.725064","last_undegraded":"2024-03-24 10:39:21.725064","last_fullsized":"2024-03-24 10:39:21.725064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745178","last_change":"2024-03-24 10:39:21.738160","last_active":"2024-03-24 10:39:21.745178","last_peered":"2024-03-24 10:39:21.745178","last_clean":"2024-03-24 10:39:21.745178","last_became_active":"2024-03-24 10:39:21.737855","last_became_peered":"2024-03-24 10:39:21.737855","last_unstale":"2024-03-24 10:39:21.745178","last_undegraded":"2024-03-24 10:39:21.745178","last_fullsized":"2024-03-24 10:39:21.745178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750738","last_change":"2024-03-24 10:39:21.398871","last_active":"2024-03-24 10:39:21.750738","last_peered":"2024-03-24 10:39:21.750738","last_clean":"2024-03-24 10:39:21.750738","last_became_active":"2024-03-24 10:39:21.398558","last_became_peered":"2024-03-24 10:39:21.398558","last_unstale":"2024-03-24 10:39:21.750738","last_undegraded":"2024-03-24 10:39:21.750738","last_fullsized":"2024-03-24 10:39:21.750738","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748448","last_change":"2024-03-24 10:39:21.746721","last_active":"2024-03-24 10:39:21.748448","last_peered":"2024-03-24 10:39:21.748448","last_clean":"2024-03-24 10:39:21.748448","last_became_active":"2024-03-24 10:39:21.746369","last_became_peered":"2024-03-24 10:39:21.746369","last_unstale":"2024-03-24 10:39:21.748448","last_undegraded":"2024-03-24 10:39:21.748448","last_fullsized":"2024-03-24 10:39:21.748448","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716479","last_change":"2024-03-24 10:39:21.397102","last_active":"2024-03-24 10:39:21.716479","last_peered":"2024-03-24 10:39:21.716479","last_clean":"2024-03-24 10:39:21.716479","last_became_active":"2024-03-24 10:39:21.396712","last_became_peered":"2024-03-24 10:39:21.396712","last_unstale":"2024-03-24 10:39:21.716479","last_undegraded":"2024-03-24 10:39:21.716479","last_fullsized":"2024-03-24 10:39:21.716479","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748075","last_change":"2024-03-24 10:39:21.742483","last_active":"2024-03-24 10:39:21.748075","last_peered":"2024-03-24 10:39:21.748075","last_clean":"2024-03-24 10:39:21.748075","last_became_active":"2024-03-24 10:39:21.740541","last_became_peered":"2024-03-24 10:39:21.740541","last_unstale":"2024-03-24 10:39:21.748075","last_undegraded":"2024-03-24 10:39:21.748075","last_fullsized":"2024-03-24 10:39:21.748075","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750097","last_change":"2024-03-24 10:39:21.411702","last_active":"2024-03-24 10:39:21.750097","last_peered":"2024-03-24 10:39:21.750097","last_clean":"2024-03-24 10:39:21.750097","last_became_active":"2024-03-24 10:39:21.410083","last_became_peered":"2024-03-24 10:39:21.410083","last_unstale":"2024-03-24 10:39:21.750097","last_undegraded":"2024-03-24 10:39:21.750097","last_fullsized":"2024-03-24 10:39:21.750097","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750114","last_change":"2024-03-24 10:39:21.749409","last_active":"2024-03-24 10:39:21.750114","last_peered":"2024-03-24 10:39:21.750114","last_clean":"2024-03-24 10:39:21.750114","last_became_active":"2024-03-24 10:39:21.749109","last_became_peered":"2024-03-24 10:39:21.749109","last_unstale":"2024-03-24 10:39:21.750114","last_undegraded":"2024-03-24 10:39:21.750114","last_fullsized":"2024-03-24 10:39:21.750114","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724400","last_change":"2024-03-24 10:39:21.400428","last_active":"2024-03-24 10:39:21.724400","last_peered":"2024-03-24 10:39:21.724400","last_clean":"2024-03-24 10:39:21.724400","last_became_active":"2024-03-24 10:39:21.400131","last_became_peered":"2024-03-24 10:39:21.400131","last_unstale":"2024-03-24 10:39:21.724400","last_undegraded":"2024-03-24 10:39:21.724400","last_fullsized":"2024-03-24 10:39:21.724400","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744265","last_change":"2024-03-24 10:39:21.735779","last_active":"2024-03-24 10:39:21.744265","last_peered":"2024-03-24 10:39:21.744265","last_clean":"2024-03-24 10:39:21.744265","last_became_active":"2024-03-24 10:39:21.735484","last_became_peered":"2024-03-24 10:39:21.735484","last_unstale":"2024-03-24 10:39:21.744265","last_undegraded":"2024-03-24 10:39:21.744265","last_fullsized":"2024-03-24 10:39:21.744265","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726445","last_change":"2024-03-24 10:39:21.411540","last_active":"2024-03-24 10:39:21.726445","last_peered":"2024-03-24 10:39:21.726445","last_clean":"2024-03-24 10:39:21.726445","last_became_active":"2024-03-24 10:39:21.410761","last_became_peered":"2024-03-24 10:39:21.410761","last_unstale":"2024-03-24 10:39:21.726445","last_undegraded":"2024-03-24 10:39:21.726445","last_fullsized":"2024-03-24 10:39:21.726445","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744906","last_change":"2024-03-24 10:39:21.736699","last_active":"2024-03-24 10:39:21.744906","last_peered":"2024-03-24 10:39:21.744906","last_clean":"2024-03-24 10:39:21.744906","last_became_active":"2024-03-24 10:39:21.736384","last_became_peered":"2024-03-24 10:39:21.736384","last_unstale":"2024-03-24 10:39:21.744906","last_undegraded":"2024-03-24 10:39:21.744906","last_fullsized":"2024-03-24 10:39:21.744906","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747414","last_change":"2024-03-24 10:39:21.398063","last_active":"2024-03-24 10:39:21.747414","last_peered":"2024-03-24 10:39:21.747414","last_clean":"2024-03-24 10:39:21.747414","last_became_active":"2024-03-24 10:39:21.397278","last_became_peered":"2024-03-24 10:39:21.397278","last_unstale":"2024-03-24 10:39:21.747414","last_undegraded":"2024-03-24 10:39:21.747414","last_fullsized":"2024-03-24 10:39:21.747414","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749692","last_change":"2024-03-24 10:39:21.747336","last_active":"2024-03-24 10:39:21.749692","last_peered":"2024-03-24 10:39:21.749692","last_clean":"2024-03-24 10:39:21.749692","last_became_active":"2024-03-24 10:39:21.746919","last_became_peered":"2024-03-24 10:39:21.746919","last_unstale":"2024-03-24 10:39:21.749692","last_undegraded":"2024-03-24 10:39:21.749692","last_fullsized":"2024-03-24 10:39:21.749692","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725976","last_change":"2024-03-24 10:39:21.404083","last_active":"2024-03-24 10:39:21.725976","last_peered":"2024-03-24 10:39:21.725976","last_clean":"2024-03-24 10:39:21.725976","last_became_active":"2024-03-24 10:39:21.403747","last_became_peered":"2024-03-24 10:39:21.403747","last_unstale":"2024-03-24 10:39:21.725976","last_undegraded":"2024-03-24 10:39:21.725976","last_fullsized":"2024-03-24 10:39:21.725976","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750584","last_change":"2024-03-24 10:39:21.749778","last_active":"2024-03-24 10:39:21.750584","last_peered":"2024-03-24 10:39:21.750584","last_clean":"2024-03-24 10:39:21.750584","last_became_active":"2024-03-24 10:39:21.749344","last_became_peered":"2024-03-24 10:39:21.749344","last_unstale":"2024-03-24 10:39:21.750584","last_undegraded":"2024-03-24 10:39:21.750584","last_fullsized":"2024-03-24 10:39:21.750584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715463","last_change":"2024-03-24 10:39:21.394117","last_active":"2024-03-24 10:39:21.715463","last_peered":"2024-03-24 10:39:21.715463","last_clean":"2024-03-24 10:39:21.715463","last_became_active":"2024-03-24 10:39:21.390303","last_became_peered":"2024-03-24 10:39:21.390303","last_unstale":"2024-03-24 10:39:21.715463","last_undegraded":"2024-03-24 10:39:21.715463","last_fullsized":"2024-03-24 10:39:21.715463","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747294","last_change":"2024-03-24 10:39:21.738700","last_active":"2024-03-24 10:39:21.747294","last_peered":"2024-03-24 10:39:21.747294","last_clean":"2024-03-24 10:39:21.747294","last_became_active":"2024-03-24 10:39:21.738406","last_became_peered":"2024-03-24 10:39:21.738406","last_unstale":"2024-03-24 10:39:21.747294","last_undegraded":"2024-03-24 10:39:21.747294","last_fullsized":"2024-03-24 10:39:21.747294","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744340","last_change":"2024-03-24 10:39:21.392998","last_active":"2024-03-24 10:39:21.744340","last_peered":"2024-03-24 10:39:21.744340","last_clean":"2024-03-24 10:39:21.744340","last_became_active":"2024-03-24 10:39:21.392663","last_became_peered":"2024-03-24 10:39:21.392663","last_unstale":"2024-03-24 10:39:21.744340","last_undegraded":"2024-03-24 10:39:21.744340","last_fullsized":"2024-03-24 10:39:21.744340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749623","last_change":"2024-03-24 10:39:21.748045","last_active":"2024-03-24 10:39:21.749623","last_peered":"2024-03-24 10:39:21.749623","last_clean":"2024-03-24 10:39:21.749623","last_became_active":"2024-03-24 10:39:21.747686","last_became_peered":"2024-03-24 10:39:21.747686","last_unstale":"2024-03-24 10:39:21.749623","last_undegraded":"2024-03-24 10:39:21.749623","last_fullsized":"2024-03-24 10:39:21.749623","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756879","last_change":"2024-03-24 10:39:21.405112","last_active":"2024-03-24 10:39:21.756879","last_peered":"2024-03-24 10:39:21.756879","last_clean":"2024-03-24 10:39:21.756879","last_became_active":"2024-03-24 10:39:21.404792","last_became_peered":"2024-03-24 10:39:21.404792","last_unstale":"2024-03-24 10:39:21.756879","last_undegraded":"2024-03-24 10:39:21.756879","last_fullsized":"2024-03-24 10:39:21.756879","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748245","last_change":"2024-03-24 10:39:21.741272","last_active":"2024-03-24 10:39:21.748245","last_peered":"2024-03-24 10:39:21.748245","last_clean":"2024-03-24 10:39:21.748245","last_became_active":"2024-03-24 10:39:21.740190","last_became_peered":"2024-03-24 10:39:21.740190","last_unstale":"2024-03-24 10:39:21.748245","last_undegraded":"2024-03-24 10:39:21.748245","last_fullsized":"2024-03-24 10:39:21.748245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723769","last_change":"2024-03-24 10:39:21.407652","last_active":"2024-03-24 10:39:21.723769","last_peered":"2024-03-24 10:39:21.723769","last_clean":"2024-03-24 10:39:21.723769","last_became_active":"2024-03-24 10:39:21.407281","last_became_peered":"2024-03-24 10:39:21.407281","last_unstale":"2024-03-24 10:39:21.723769","last_undegraded":"2024-03-24 10:39:21.723769","last_fullsized":"2024-03-24 10:39:21.723769","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744581","last_change":"2024-03-24 10:39:21.734684","last_active":"2024-03-24 10:39:21.744581","last_peered":"2024-03-24 10:39:21.744581","last_clean":"2024-03-24 10:39:21.744581","last_became_active":"2024-03-24 10:39:21.734378","last_became_peered":"2024-03-24 10:39:21.734378","last_unstale":"2024-03-24 10:39:21.744581","last_undegraded":"2024-03-24 10:39:21.744581","last_fullsized":"2024-03-24 10:39:21.744581","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724208","last_change":"2024-03-24 10:39:21.400591","last_active":"2024-03-24 10:39:21.724208","last_peered":"2024-03-24 10:39:21.724208","last_clean":"2024-03-24 10:39:21.724208","last_became_active":"2024-03-24 10:39:21.400291","last_became_peered":"2024-03-24 10:39:21.400291","last_unstale":"2024-03-24 10:39:21.724208","last_undegraded":"2024-03-24 10:39:21.724208","last_fullsized":"2024-03-24 10:39:21.724208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.734103","last_change":"2024-03-24 10:39:21.728699","last_active":"2024-03-24 10:39:21.734103","last_peered":"2024-03-24 10:39:21.734103","last_clean":"2024-03-24 10:39:21.734103","last_became_active":"2024-03-24 10:39:21.728399","last_became_peered":"2024-03-24 10:39:21.728399","last_unstale":"2024-03-24 10:39:21.734103","last_undegraded":"2024-03-24 10:39:21.734103","last_fullsized":"2024-03-24 10:39:21.734103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737300","last_change":"2024-03-24 10:39:21.389698","last_active":"2024-03-24 10:39:21.737300","last_peered":"2024-03-24 10:39:21.737300","last_clean":"2024-03-24 10:39:21.737300","last_became_active":"2024-03-24 10:39:21.389371","last_became_peered":"2024-03-24 10:39:21.389371","last_unstale":"2024-03-24 10:39:21.737300","last_undegraded":"2024-03-24 10:39:21.737300","last_fullsized":"2024-03-24 10:39:21.737300","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745793","last_change":"2024-03-24 10:39:21.736640","last_active":"2024-03-24 10:39:21.745793","last_peered":"2024-03-24 10:39:21.745793","last_clean":"2024-03-24 10:39:21.745793","last_became_active":"2024-03-24 10:39:21.736337","last_became_peered":"2024-03-24 10:39:21.736337","last_unstale":"2024-03-24 10:39:21.745793","last_undegraded":"2024-03-24 10:39:21.745793","last_fullsized":"2024-03-24 10:39:21.745793","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725719","last_change":"2024-03-24 10:39:21.398253","last_active":"2024-03-24 10:39:21.725719","last_peered":"2024-03-24 10:39:21.725719","last_clean":"2024-03-24 10:39:21.725719","last_became_active":"2024-03-24 10:39:21.397537","last_became_peered":"2024-03-24 10:39:21.397537","last_unstale":"2024-03-24 10:39:21.725719","last_undegraded":"2024-03-24 10:39:21.725719","last_fullsized":"2024-03-24 10:39:21.725719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750751","last_change":"2024-03-24 10:39:21.749427","last_active":"2024-03-24 10:39:21.750751","last_peered":"2024-03-24 10:39:21.750751","last_clean":"2024-03-24 10:39:21.750751","last_became_active":"2024-03-24 10:39:21.749070","last_became_peered":"2024-03-24 10:39:21.749070","last_unstale":"2024-03-24 10:39:21.750751","last_undegraded":"2024-03-24 10:39:21.750751","last_fullsized":"2024-03-24 10:39:21.750751","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722365","last_change":"2024-03-24 10:39:21.401943","last_active":"2024-03-24 10:39:21.722365","last_peered":"2024-03-24 10:39:21.722365","last_clean":"2024-03-24 10:39:21.722365","last_became_active":"2024-03-24 10:39:21.396400","last_became_peered":"2024-03-24 10:39:21.396400","last_unstale":"2024-03-24 10:39:21.722365","last_undegraded":"2024-03-24 10:39:21.722365","last_fullsized":"2024-03-24 10:39:21.722365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737949","last_change":"2024-03-24 10:39:21.731745","last_active":"2024-03-24 10:39:21.737949","last_peered":"2024-03-24 10:39:21.737949","last_clean":"2024-03-24 10:39:21.737949","last_became_active":"2024-03-24 10:39:21.731419","last_became_peered":"2024-03-24 10:39:21.731419","last_unstale":"2024-03-24 10:39:21.737949","last_undegraded":"2024-03-24 10:39:21.737949","last_fullsized":"2024-03-24 10:39:21.737949","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750282","last_change":"2024-03-24 10:39:21.390586","last_active":"2024-03-24 10:39:21.750282","last_peered":"2024-03-24 10:39:21.750282","last_clean":"2024-03-24 10:39:21.750282","last_became_active":"2024-03-24 10:39:21.390097","last_became_peered":"2024-03-24 10:39:21.390097","last_unstale":"2024-03-24 10:39:21.750282","last_undegraded":"2024-03-24 10:39:21.750282","last_fullsized":"2024-03-24 10:39:21.750282","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744182","last_change":"2024-03-24 10:39:21.734074","last_active":"2024-03-24 10:39:21.744182","last_peered":"2024-03-24 10:39:21.744182","last_clean":"2024-03-24 10:39:21.744182","last_became_active":"2024-03-24 10:39:21.733775","last_became_peered":"2024-03-24 10:39:21.733775","last_unstale":"2024-03-24 10:39:21.744182","last_undegraded":"2024-03-24 10:39:21.744182","last_fullsized":"2024-03-24 10:39:21.744182","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.746919","last_change":"2024-03-24 10:39:21.403801","last_active":"2024-03-24 10:39:21.746919","last_peered":"2024-03-24 10:39:21.746919","last_clean":"2024-03-24 10:39:21.746919","last_became_active":"2024-03-24 10:39:21.403475","last_became_peered":"2024-03-24 10:39:21.403475","last_unstale":"2024-03-24 10:39:21.746919","last_undegraded":"2024-03-24 10:39:21.746919","last_fullsized":"2024-03-24 10:39:21.746919","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745647","last_change":"2024-03-24 10:39:21.735800","last_active":"2024-03-24 10:39:21.745647","last_peered":"2024-03-24 10:39:21.745647","last_clean":"2024-03-24 10:39:21.745647","last_became_active":"2024-03-24 10:39:21.735499","last_became_peered":"2024-03-24 10:39:21.735499","last_unstale":"2024-03-24 10:39:21.745647","last_undegraded":"2024-03-24 10:39:21.745647","last_fullsized":"2024-03-24 10:39:21.745647","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747151","last_change":"2024-03-24 10:39:21.398511","last_active":"2024-03-24 10:39:21.747151","last_peered":"2024-03-24 10:39:21.747151","last_clean":"2024-03-24 10:39:21.747151","last_became_active":"2024-03-24 10:39:21.397759","last_became_peered":"2024-03-24 10:39:21.397759","last_unstale":"2024-03-24 10:39:21.747151","last_undegraded":"2024-03-24 10:39:21.747151","last_fullsized":"2024-03-24 10:39:21.747151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.754786","last_change":"2024-03-24 10:39:21.750697","last_active":"2024-03-24 10:39:21.754786","last_peered":"2024-03-24 10:39:21.754786","last_clean":"2024-03-24 10:39:21.754786","last_became_active":"2024-03-24 10:39:21.750360","last_became_peered":"2024-03-24 10:39:21.750360","last_unstale":"2024-03-24 10:39:21.754786","last_undegraded":"2024-03-24 10:39:21.754786","last_fullsized":"2024-03-24 10:39:21.754786","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723664","last_change":"2024-03-24 10:39:21.404992","last_active":"2024-03-24 10:39:21.723664","last_peered":"2024-03-24 10:39:21.723664","last_clean":"2024-03-24 10:39:21.723664","last_became_active":"2024-03-24 10:39:21.404656","last_became_peered":"2024-03-24 10:39:21.404656","last_unstale":"2024-03-24 10:39:21.723664","last_undegraded":"2024-03-24 10:39:21.723664","last_fullsized":"2024-03-24 10:39:21.723664","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756515","last_change":"2024-03-24 10:39:21.753684","last_active":"2024-03-24 10:39:21.756515","last_peered":"2024-03-24 10:39:21.756515","last_clean":"2024-03-24 10:39:21.756515","last_became_active":"2024-03-24 10:39:21.753331","last_became_peered":"2024-03-24 10:39:21.753331","last_unstale":"2024-03-24 10:39:21.756515","last_undegraded":"2024-03-24 10:39:21.756515","last_fullsized":"2024-03-24 10:39:21.756515","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.730085","last_change":"2024-03-24 10:39:21.411354","last_active":"2024-03-24 10:39:21.730085","last_peered":"2024-03-24 10:39:21.730085","last_clean":"2024-03-24 10:39:21.730085","last_became_active":"2024-03-24 10:39:21.410898","last_became_peered":"2024-03-24 10:39:21.410898","last_unstale":"2024-03-24 10:39:21.730085","last_undegraded":"2024-03-24 10:39:21.730085","last_fullsized":"2024-03-24 10:39:21.730085","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737268","last_change":"2024-03-24 10:39:21.731852","last_active":"2024-03-24 10:39:21.737268","last_peered":"2024-03-24 10:39:21.737268","last_clean":"2024-03-24 10:39:21.737268","last_became_active":"2024-03-24 10:39:21.731546","last_became_peered":"2024-03-24 10:39:21.731546","last_unstale":"2024-03-24 10:39:21.737268","last_undegraded":"2024-03-24 10:39:21.737268","last_fullsized":"2024-03-24 10:39:21.737268","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748581","last_change":"2024-03-24 10:39:21.395928","last_active":"2024-03-24 10:39:21.748581","last_peered":"2024-03-24 10:39:21.748581","last_clean":"2024-03-24 10:39:21.748581","last_became_active":"2024-03-24 10:39:21.395582","last_became_peered":"2024-03-24 10:39:21.395582","last_unstale":"2024-03-24 10:39:21.748581","last_undegraded":"2024-03-24 10:39:21.748581","last_fullsized":"2024-03-24 10:39:21.748581","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]}]}} 2024-03-24T10:39:28.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.003 7f351692d700 1 Processor -- start 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 -- start start 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 0x7f35100f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100f91b0 con 0x7f35100f1e40 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351010f060 con 0x7f35100f58a0 2024-03-24T10:39:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f351692d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35101ac600 con 0x7f35100f2290 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350f5eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 0x7f35100f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46340/0 (socket says 172.21.15.73:46340) 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 -- 172.21.15.73:0/2052555187 learned_addr learned my addr 172.21.15.73:0/2052555187 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350edea700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f35100f1e40 0x7f351010e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36430/0 (socket says 172.21.15.73:36430) 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350e5e9700 1 -- 172.21.15.73:0/2052555187 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603379167 0 0) 0x7f3500001110 con 0x7f35100f1e40 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350e5e9700 1 -- 172.21.15.73:0/2052555187 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc003270 con 0x7f35100f1e40 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 -- 172.21.15.73:0/2052555187 >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 msgr2=0x7f35100f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 --2- 172.21.15.73:0/2052555187 >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 0x7f35100f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 -- 172.21.15.73:0/2052555187 >> v1:172.21.15.73:6789/0 conn(0x7f35100f1e40 legacy=0x7f351010e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350fdec700 1 -- 172.21.15.73:0/2052555187 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35101ac7b0 con 0x7f35100f2290 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.004 7f350f5eb700 1 --2- 172.21.15.73:0/2052555187 >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 0x7f35100f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f350fdec700 1 --2- 172.21.15.73:0/2052555187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f35080032f0 tx=0x7f3508009d60).ready entity=mon.2 client_cookie=cb3f43efa01092b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f350e5e9700 1 -- 172.21.15.73:0/2052555187 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f35101ac7b0 con 0x7f35100f2290 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f350e5e9700 1 -- 172.21.15.73:0/2052555187 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800b880 con 0x7f35100f2290 2024-03-24T10:39:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f350e5e9700 1 -- 172.21.15.73:0/2052555187 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f350800ba60 con 0x7f35100f2290 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 -- 172.21.15.73:0/2052555187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 msgr2=0x7f351010ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 --2- 172.21.15.73:0/2052555187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f35080032f0 tx=0x7f3508009d60).stop 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 -- 172.21.15.73:0/2052555187 shutdown_connections 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 --2- 172.21.15.73:0/2052555187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100f2290 0x7f351010ea30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 --2- 172.21.15.73:0/2052555187 >> v2:172.21.15.73:3300/0 conn(0x7f35100f58a0 0x7f35100f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 -- 172.21.15.73:0/2052555187 >> 172.21.15.73:0/2052555187 conn(0x7f35101139f0 msgr2=0x7f35100f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 -- 172.21.15.73:0/2052555187 shutdown_connections 2024-03-24T10:39:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.005 7f351692d700 1 -- 172.21.15.73:0/2052555187 wait complete. 2024-03-24T10:39:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 Processor -- start 2024-03-24T10:39:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 -- start start 2024-03-24T10:39:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35100c41b0 0x7f35101b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100c4b90 con 0x7f35101b4e60 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100c1210 con 0x7f35100c41b0 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.028 7f351692d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35100bc4a0 con 0x7f35100c3730 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350fdec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46342/0 (socket says 172.21.15.73:46342) 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350fdec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56250/0 (socket says 172.21.15.73:56250) 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 -- 172.21.15.73:0/277896646 learned_addr learned my addr 172.21.15.73:0/277896646 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350edea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35100c41b0 0x7f35101b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 -- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35100c41b0 msgr2=0x7f35101b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35100c41b0 0x7f35101b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 -- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 msgr2=0x7f35101bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 -- 172.21.15.73:0/277896646 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35101b52b0 con 0x7f35100c3730 2024-03-24T10:39:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350fdec700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350f5eb700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f35100bcbc0 tx=0x7f350400bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f35101b52b0 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400ee60 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f351692d700 1 -- 172.21.15.73:0/277896646 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35101b55d0 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f350400f040 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.029 7f351692d700 1 -- 172.21.15.73:0/277896646 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35101bc0b0 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.030 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3504011070 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.030 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3504010040 con 0x7f35100c3730 2024-03-24T10:39:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.030 7f351692d700 1 -- 172.21.15.73:0/277896646 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100f0860 con 0x7f35100c3730 2024-03-24T10:39:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.033 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f350400c620 con 0x7f35100c3730 2024-03-24T10:39:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.134 7f351692d700 1 -- 172.21.15.73:0/277896646 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f35100c4e10 con 0x7f34f00145b0 2024-03-24T10:39:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.142 7f350cde6700 1 -- 172.21.15.73:0/277896646 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306141 (unknown 2965378022 0 4272413528) 0x7f35100c4e10 con 0x7f34f00145b0 2024-03-24T10:39:29.146 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 -- 172.21.15.73:0/277896646 >> v1:172.21.15.73:6816/43277 conn(0x7f34f00145b0 legacy=0x7f34f0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 -- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 msgr2=0x7f35100c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f35100bcbc0 tx=0x7f350400bf70).stop 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 -- 172.21.15.73:0/277896646 shutdown_connections 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101b4e60 0x7f35101bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f35100c3730 0x7f35100c3b80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 --2- 172.21.15.73:0/277896646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35100c41b0 0x7f35101b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.144 7f351692d700 1 -- 172.21.15.73:0/277896646 >> 172.21.15.73:0/277896646 conn(0x7f35100c5cc0 msgr2=0x7f35100d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.145 7f351692d700 1 -- 172.21.15.73:0/277896646 shutdown_connections 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.145 7f351692d700 1 -- 172.21.15.73:0/277896646 wait complete. 2024-03-24T10:39:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:29.156 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-24 10:39:29.113283","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000877"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743122","last_change":"2024-03-24 10:39:21.733062","last_active":"2024-03-24 10:39:21.743122","last_peered":"2024-03-24 10:39:21.743122","last_clean":"2024-03-24 10:39:21.743122","last_became_active":"2024-03-24 10:39:21.732749","last_became_peered":"2024-03-24 10:39:21.732749","last_unstale":"2024-03-24 10:39:21.743122","last_undegraded":"2024-03-24 10:39:21.743122","last_fullsized":"2024-03-24 10:39:21.743122","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723064","last_change":"2024-03-24 10:39:21.410484","last_active":"2024-03-24 10:39:21.723064","last_peered":"2024-03-24 10:39:21.723064","last_clean":"2024-03-24 10:39:21.723064","last_became_active":"2024-03-24 10:39:21.410014","last_became_peered":"2024-03-24 10:39:21.410014","last_unstale":"2024-03-24 10:39:21.723064","last_undegraded":"2024-03-24 10:39:21.723064","last_fullsized":"2024-03-24 10:39:21.723064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756881","last_change":"2024-03-24 10:39:21.754967","last_active":"2024-03-24 10:39:21.756881","last_peered":"2024-03-24 10:39:21.756881","last_clean":"2024-03-24 10:39:21.756881","last_became_active":"2024-03-24 10:39:21.754511","last_became_peered":"2024-03-24 10:39:21.754511","last_unstale":"2024-03-24 10:39:21.756881","last_undegraded":"2024-03-24 10:39:21.756881","last_fullsized":"2024-03-24 10:39:21.756881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722751","last_change":"2024-03-24 10:39:21.405477","last_active":"2024-03-24 10:39:21.722751","last_peered":"2024-03-24 10:39:21.722751","last_clean":"2024-03-24 10:39:21.722751","last_became_active":"2024-03-24 10:39:21.405145","last_became_peered":"2024-03-24 10:39:21.405145","last_unstale":"2024-03-24 10:39:21.722751","last_undegraded":"2024-03-24 10:39:21.722751","last_fullsized":"2024-03-24 10:39:21.722751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750731","last_change":"2024-03-24 10:39:21.749349","last_active":"2024-03-24 10:39:21.750731","last_peered":"2024-03-24 10:39:21.750731","last_clean":"2024-03-24 10:39:21.750731","last_became_active":"2024-03-24 10:39:21.749024","last_became_peered":"2024-03-24 10:39:21.749024","last_unstale":"2024-03-24 10:39:21.750731","last_undegraded":"2024-03-24 10:39:21.750731","last_fullsized":"2024-03-24 10:39:21.750731","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724246","last_change":"2024-03-24 10:39:21.405055","last_active":"2024-03-24 10:39:21.724246","last_peered":"2024-03-24 10:39:21.724246","last_clean":"2024-03-24 10:39:21.724246","last_became_active":"2024-03-24 10:39:21.404748","last_became_peered":"2024-03-24 10:39:21.404748","last_unstale":"2024-03-24 10:39:21.724246","last_undegraded":"2024-03-24 10:39:21.724246","last_fullsized":"2024-03-24 10:39:21.724246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745143","last_change":"2024-03-24 10:39:21.742175","last_active":"2024-03-24 10:39:21.745143","last_peered":"2024-03-24 10:39:21.745143","last_clean":"2024-03-24 10:39:21.745143","last_became_active":"2024-03-24 10:39:21.741904","last_became_peered":"2024-03-24 10:39:21.741904","last_unstale":"2024-03-24 10:39:21.745143","last_undegraded":"2024-03-24 10:39:21.745143","last_fullsized":"2024-03-24 10:39:21.745143","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721675","last_change":"2024-03-24 10:39:21.405185","last_active":"2024-03-24 10:39:21.721675","last_peered":"2024-03-24 10:39:21.721675","last_clean":"2024-03-24 10:39:21.721675","last_became_active":"2024-03-24 10:39:21.404576","last_became_peered":"2024-03-24 10:39:21.404576","last_unstale":"2024-03-24 10:39:21.721675","last_undegraded":"2024-03-24 10:39:21.721675","last_fullsized":"2024-03-24 10:39:21.721675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755187","last_change":"2024-03-24 10:39:21.751864","last_active":"2024-03-24 10:39:21.755187","last_peered":"2024-03-24 10:39:21.755187","last_clean":"2024-03-24 10:39:21.755187","last_became_active":"2024-03-24 10:39:21.751297","last_became_peered":"2024-03-24 10:39:21.751297","last_unstale":"2024-03-24 10:39:21.755187","last_undegraded":"2024-03-24 10:39:21.755187","last_fullsized":"2024-03-24 10:39:21.755187","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724589","last_change":"2024-03-24 10:39:21.393191","last_active":"2024-03-24 10:39:21.724589","last_peered":"2024-03-24 10:39:21.724589","last_clean":"2024-03-24 10:39:21.724589","last_became_active":"2024-03-24 10:39:21.392863","last_became_peered":"2024-03-24 10:39:21.392863","last_unstale":"2024-03-24 10:39:21.724589","last_undegraded":"2024-03-24 10:39:21.724589","last_fullsized":"2024-03-24 10:39:21.724589","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756489","last_change":"2024-03-24 10:39:21.753654","last_active":"2024-03-24 10:39:21.756489","last_peered":"2024-03-24 10:39:21.756489","last_clean":"2024-03-24 10:39:21.756489","last_became_active":"2024-03-24 10:39:21.753306","last_became_peered":"2024-03-24 10:39:21.753306","last_unstale":"2024-03-24 10:39:21.756489","last_undegraded":"2024-03-24 10:39:21.756489","last_fullsized":"2024-03-24 10:39:21.756489","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729807","last_change":"2024-03-24 10:39:21.398093","last_active":"2024-03-24 10:39:21.729807","last_peered":"2024-03-24 10:39:21.729807","last_clean":"2024-03-24 10:39:21.729807","last_became_active":"2024-03-24 10:39:21.397415","last_became_peered":"2024-03-24 10:39:21.397415","last_unstale":"2024-03-24 10:39:21.729807","last_undegraded":"2024-03-24 10:39:21.729807","last_fullsized":"2024-03-24 10:39:21.729807","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748438","last_change":"2024-03-24 10:39:21.746784","last_active":"2024-03-24 10:39:21.748438","last_peered":"2024-03-24 10:39:21.748438","last_clean":"2024-03-24 10:39:21.748438","last_became_active":"2024-03-24 10:39:21.746406","last_became_peered":"2024-03-24 10:39:21.746406","last_unstale":"2024-03-24 10:39:21.748438","last_undegraded":"2024-03-24 10:39:21.748438","last_fullsized":"2024-03-24 10:39:21.748438","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748529","last_change":"2024-03-24 10:39:21.407422","last_active":"2024-03-24 10:39:21.748529","last_peered":"2024-03-24 10:39:21.748529","last_clean":"2024-03-24 10:39:21.748529","last_became_active":"2024-03-24 10:39:21.407030","last_became_peered":"2024-03-24 10:39:21.407030","last_unstale":"2024-03-24 10:39:21.748529","last_undegraded":"2024-03-24 10:39:21.748529","last_fullsized":"2024-03-24 10:39:21.748529","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756688","last_change":"2024-03-24 10:39:21.754359","last_active":"2024-03-24 10:39:21.756688","last_peered":"2024-03-24 10:39:21.756688","last_clean":"2024-03-24 10:39:21.756688","last_became_active":"2024-03-24 10:39:21.754061","last_became_peered":"2024-03-24 10:39:21.754061","last_unstale":"2024-03-24 10:39:21.756688","last_undegraded":"2024-03-24 10:39:21.756688","last_fullsized":"2024-03-24 10:39:21.756688","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750719","last_change":"2024-03-24 10:39:21.389253","last_active":"2024-03-24 10:39:21.750719","last_peered":"2024-03-24 10:39:21.750719","last_clean":"2024-03-24 10:39:21.750719","last_became_active":"2024-03-24 10:39:21.388938","last_became_peered":"2024-03-24 10:39:21.388938","last_unstale":"2024-03-24 10:39:21.750719","last_undegraded":"2024-03-24 10:39:21.750719","last_fullsized":"2024-03-24 10:39:21.750719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748240","last_change":"2024-03-24 10:39:21.743588","last_active":"2024-03-24 10:39:21.748240","last_peered":"2024-03-24 10:39:21.748240","last_clean":"2024-03-24 10:39:21.748240","last_became_active":"2024-03-24 10:39:21.742056","last_became_peered":"2024-03-24 10:39:21.742056","last_unstale":"2024-03-24 10:39:21.748240","last_undegraded":"2024-03-24 10:39:21.748240","last_fullsized":"2024-03-24 10:39:21.748240","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755402","last_change":"2024-03-24 10:39:21.413014","last_active":"2024-03-24 10:39:21.755402","last_peered":"2024-03-24 10:39:21.755402","last_clean":"2024-03-24 10:39:21.755402","last_became_active":"2024-03-24 10:39:21.412716","last_became_peered":"2024-03-24 10:39:21.412716","last_unstale":"2024-03-24 10:39:21.755402","last_undegraded":"2024-03-24 10:39:21.755402","last_fullsized":"2024-03-24 10:39:21.755402","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756575","last_change":"2024-03-24 10:39:21.751937","last_active":"2024-03-24 10:39:21.756575","last_peered":"2024-03-24 10:39:21.756575","last_clean":"2024-03-24 10:39:21.756575","last_became_active":"2024-03-24 10:39:21.751709","last_became_peered":"2024-03-24 10:39:21.751709","last_unstale":"2024-03-24 10:39:21.756575","last_undegraded":"2024-03-24 10:39:21.756575","last_fullsized":"2024-03-24 10:39:21.756575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722537","last_change":"2024-03-24 10:39:21.409360","last_active":"2024-03-24 10:39:21.722537","last_peered":"2024-03-24 10:39:21.722537","last_clean":"2024-03-24 10:39:21.722537","last_became_active":"2024-03-24 10:39:21.409159","last_became_peered":"2024-03-24 10:39:21.409159","last_unstale":"2024-03-24 10:39:21.722537","last_undegraded":"2024-03-24 10:39:21.722537","last_fullsized":"2024-03-24 10:39:21.722537","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743861","last_change":"2024-03-24 10:39:21.733813","last_active":"2024-03-24 10:39:21.743861","last_peered":"2024-03-24 10:39:21.743861","last_clean":"2024-03-24 10:39:21.743861","last_became_active":"2024-03-24 10:39:21.733530","last_became_peered":"2024-03-24 10:39:21.733530","last_unstale":"2024-03-24 10:39:21.743861","last_undegraded":"2024-03-24 10:39:21.743861","last_fullsized":"2024-03-24 10:39:21.743861","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725758","last_change":"2024-03-24 10:39:21.412405","last_active":"2024-03-24 10:39:21.725758","last_peered":"2024-03-24 10:39:21.725758","last_clean":"2024-03-24 10:39:21.725758","last_became_active":"2024-03-24 10:39:21.412066","last_became_peered":"2024-03-24 10:39:21.412066","last_unstale":"2024-03-24 10:39:21.725758","last_undegraded":"2024-03-24 10:39:21.725758","last_fullsized":"2024-03-24 10:39:21.725758","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749646","last_change":"2024-03-24 10:39:21.746871","last_active":"2024-03-24 10:39:21.749646","last_peered":"2024-03-24 10:39:21.749646","last_clean":"2024-03-24 10:39:21.749646","last_became_active":"2024-03-24 10:39:21.746393","last_became_peered":"2024-03-24 10:39:21.746393","last_unstale":"2024-03-24 10:39:21.749646","last_undegraded":"2024-03-24 10:39:21.749646","last_fullsized":"2024-03-24 10:39:21.749646","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745363","last_change":"2024-03-24 10:39:21.386589","last_active":"2024-03-24 10:39:21.745363","last_peered":"2024-03-24 10:39:21.745363","last_clean":"2024-03-24 10:39:21.745363","last_became_active":"2024-03-24 10:39:21.386295","last_became_peered":"2024-03-24 10:39:21.386295","last_unstale":"2024-03-24 10:39:21.745363","last_undegraded":"2024-03-24 10:39:21.745363","last_fullsized":"2024-03-24 10:39:21.745363","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744247","last_change":"2024-03-24 10:39:21.733805","last_active":"2024-03-24 10:39:21.744247","last_peered":"2024-03-24 10:39:21.744247","last_clean":"2024-03-24 10:39:21.744247","last_became_active":"2024-03-24 10:39:21.733501","last_became_peered":"2024-03-24 10:39:21.733501","last_unstale":"2024-03-24 10:39:21.744247","last_undegraded":"2024-03-24 10:39:21.744247","last_fullsized":"2024-03-24 10:39:21.744247","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747691","last_change":"2024-03-24 10:39:21.398400","last_active":"2024-03-24 10:39:21.747691","last_peered":"2024-03-24 10:39:21.747691","last_clean":"2024-03-24 10:39:21.747691","last_became_active":"2024-03-24 10:39:21.397859","last_became_peered":"2024-03-24 10:39:21.397859","last_unstale":"2024-03-24 10:39:21.747691","last_undegraded":"2024-03-24 10:39:21.747691","last_fullsized":"2024-03-24 10:39:21.747691","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747817","last_change":"2024-03-24 10:39:21.741686","last_active":"2024-03-24 10:39:21.747817","last_peered":"2024-03-24 10:39:21.747817","last_clean":"2024-03-24 10:39:21.747817","last_became_active":"2024-03-24 10:39:21.741119","last_became_peered":"2024-03-24 10:39:21.741119","last_unstale":"2024-03-24 10:39:21.747817","last_undegraded":"2024-03-24 10:39:21.747817","last_fullsized":"2024-03-24 10:39:21.747817","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752068","last_change":"2024-03-24 10:39:21.389678","last_active":"2024-03-24 10:39:21.752068","last_peered":"2024-03-24 10:39:21.752068","last_clean":"2024-03-24 10:39:21.752068","last_became_active":"2024-03-24 10:39:21.389377","last_became_peered":"2024-03-24 10:39:21.389377","last_unstale":"2024-03-24 10:39:21.752068","last_undegraded":"2024-03-24 10:39:21.752068","last_fullsized":"2024-03-24 10:39:21.752068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748099","last_change":"2024-03-24 10:39:21.742841","last_active":"2024-03-24 10:39:21.748099","last_peered":"2024-03-24 10:39:21.748099","last_clean":"2024-03-24 10:39:21.748099","last_became_active":"2024-03-24 10:39:21.742567","last_became_peered":"2024-03-24 10:39:21.742567","last_unstale":"2024-03-24 10:39:21.748099","last_undegraded":"2024-03-24 10:39:21.748099","last_fullsized":"2024-03-24 10:39:21.748099","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722471","last_change":"2024-03-24 10:39:21.407601","last_active":"2024-03-24 10:39:21.722471","last_peered":"2024-03-24 10:39:21.722471","last_clean":"2024-03-24 10:39:21.722471","last_became_active":"2024-03-24 10:39:21.407123","last_became_peered":"2024-03-24 10:39:21.407123","last_unstale":"2024-03-24 10:39:21.722471","last_undegraded":"2024-03-24 10:39:21.722471","last_fullsized":"2024-03-24 10:39:21.722471","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747918","last_change":"2024-03-24 10:39:21.741427","last_active":"2024-03-24 10:39:21.747918","last_peered":"2024-03-24 10:39:21.747918","last_clean":"2024-03-24 10:39:21.747918","last_became_active":"2024-03-24 10:39:21.741202","last_became_peered":"2024-03-24 10:39:21.741202","last_unstale":"2024-03-24 10:39:21.747918","last_undegraded":"2024-03-24 10:39:21.747918","last_fullsized":"2024-03-24 10:39:21.747918","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716544","last_change":"2024-03-24 10:39:21.397164","last_active":"2024-03-24 10:39:21.716544","last_peered":"2024-03-24 10:39:21.716544","last_clean":"2024-03-24 10:39:21.716544","last_became_active":"2024-03-24 10:39:21.396867","last_became_peered":"2024-03-24 10:39:21.396867","last_unstale":"2024-03-24 10:39:21.716544","last_undegraded":"2024-03-24 10:39:21.716544","last_fullsized":"2024-03-24 10:39:21.716544","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747260","last_change":"2024-03-24 10:39:21.740995","last_active":"2024-03-24 10:39:21.747260","last_peered":"2024-03-24 10:39:21.747260","last_clean":"2024-03-24 10:39:21.747260","last_became_active":"2024-03-24 10:39:21.740697","last_became_peered":"2024-03-24 10:39:21.740697","last_unstale":"2024-03-24 10:39:21.747260","last_undegraded":"2024-03-24 10:39:21.747260","last_fullsized":"2024-03-24 10:39:21.747260","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749980","last_change":"2024-03-24 10:39:21.411252","last_active":"2024-03-24 10:39:21.749980","last_peered":"2024-03-24 10:39:21.749980","last_clean":"2024-03-24 10:39:21.749980","last_became_active":"2024-03-24 10:39:21.410965","last_became_peered":"2024-03-24 10:39:21.410965","last_unstale":"2024-03-24 10:39:21.749980","last_undegraded":"2024-03-24 10:39:21.749980","last_fullsized":"2024-03-24 10:39:21.749980","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750603","last_change":"2024-03-24 10:39:21.749883","last_active":"2024-03-24 10:39:21.750603","last_peered":"2024-03-24 10:39:21.750603","last_clean":"2024-03-24 10:39:21.750603","last_became_active":"2024-03-24 10:39:21.749521","last_became_peered":"2024-03-24 10:39:21.749521","last_unstale":"2024-03-24 10:39:21.750603","last_undegraded":"2024-03-24 10:39:21.750603","last_fullsized":"2024-03-24 10:39:21.750603","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725159","last_change":"2024-03-24 10:39:21.396016","last_active":"2024-03-24 10:39:21.725159","last_peered":"2024-03-24 10:39:21.725159","last_clean":"2024-03-24 10:39:21.725159","last_became_active":"2024-03-24 10:39:21.395496","last_became_peered":"2024-03-24 10:39:21.395496","last_unstale":"2024-03-24 10:39:21.725159","last_undegraded":"2024-03-24 10:39:21.725159","last_fullsized":"2024-03-24 10:39:21.725159","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748341","last_change":"2024-03-24 10:39:21.741529","last_active":"2024-03-24 10:39:21.748341","last_peered":"2024-03-24 10:39:21.748341","last_clean":"2024-03-24 10:39:21.748341","last_became_active":"2024-03-24 10:39:21.741235","last_became_peered":"2024-03-24 10:39:21.741235","last_unstale":"2024-03-24 10:39:21.748341","last_undegraded":"2024-03-24 10:39:21.748341","last_fullsized":"2024-03-24 10:39:21.748341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.719089","last_change":"2024-03-24 10:39:21.401865","last_active":"2024-03-24 10:39:21.719089","last_peered":"2024-03-24 10:39:21.719089","last_clean":"2024-03-24 10:39:21.719089","last_became_active":"2024-03-24 10:39:21.401590","last_became_peered":"2024-03-24 10:39:21.401590","last_unstale":"2024-03-24 10:39:21.719089","last_undegraded":"2024-03-24 10:39:21.719089","last_fullsized":"2024-03-24 10:39:21.719089","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749696","last_change":"2024-03-24 10:39:21.747518","last_active":"2024-03-24 10:39:21.749696","last_peered":"2024-03-24 10:39:21.749696","last_clean":"2024-03-24 10:39:21.749696","last_became_active":"2024-03-24 10:39:21.746543","last_became_peered":"2024-03-24 10:39:21.746543","last_unstale":"2024-03-24 10:39:21.749696","last_undegraded":"2024-03-24 10:39:21.749696","last_fullsized":"2024-03-24 10:39:21.749696","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723834","last_change":"2024-03-24 10:39:21.398690","last_active":"2024-03-24 10:39:21.723834","last_peered":"2024-03-24 10:39:21.723834","last_clean":"2024-03-24 10:39:21.723834","last_became_active":"2024-03-24 10:39:21.398369","last_became_peered":"2024-03-24 10:39:21.398369","last_unstale":"2024-03-24 10:39:21.723834","last_undegraded":"2024-03-24 10:39:21.723834","last_fullsized":"2024-03-24 10:39:21.723834","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748298","last_change":"2024-03-24 10:39:21.745829","last_active":"2024-03-24 10:39:21.748298","last_peered":"2024-03-24 10:39:21.748298","last_clean":"2024-03-24 10:39:21.748298","last_became_active":"2024-03-24 10:39:21.745472","last_became_peered":"2024-03-24 10:39:21.745472","last_unstale":"2024-03-24 10:39:21.748298","last_undegraded":"2024-03-24 10:39:21.748298","last_fullsized":"2024-03-24 10:39:21.748298","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718093","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:21.718093","last_peered":"2024-03-24 10:39:21.718093","last_clean":"2024-03-24 10:39:21.718093","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:21.718093","last_undegraded":"2024-03-24 10:39:21.718093","last_fullsized":"2024-03-24 10:39:21.718093","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724305","last_change":"2024-03-24 10:39:21.400473","last_active":"2024-03-24 10:39:21.724305","last_peered":"2024-03-24 10:39:21.724305","last_clean":"2024-03-24 10:39:21.724305","last_became_active":"2024-03-24 10:39:21.400199","last_became_peered":"2024-03-24 10:39:21.400199","last_unstale":"2024-03-24 10:39:21.724305","last_undegraded":"2024-03-24 10:39:21.724305","last_fullsized":"2024-03-24 10:39:21.724305","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748222","last_change":"2024-03-24 10:39:21.743515","last_active":"2024-03-24 10:39:21.748222","last_peered":"2024-03-24 10:39:21.748222","last_clean":"2024-03-24 10:39:21.748222","last_became_active":"2024-03-24 10:39:21.740628","last_became_peered":"2024-03-24 10:39:21.740628","last_unstale":"2024-03-24 10:39:21.748222","last_undegraded":"2024-03-24 10:39:21.748222","last_fullsized":"2024-03-24 10:39:21.748222","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726669","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:21.726669","last_peered":"2024-03-24 10:39:21.726669","last_clean":"2024-03-24 10:39:21.726669","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:21.726669","last_undegraded":"2024-03-24 10:39:21.726669","last_fullsized":"2024-03-24 10:39:21.726669","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751900","last_change":"2024-03-24 10:39:21.410337","last_active":"2024-03-24 10:39:21.751900","last_peered":"2024-03-24 10:39:21.751900","last_clean":"2024-03-24 10:39:21.751900","last_became_active":"2024-03-24 10:39:21.410037","last_became_peered":"2024-03-24 10:39:21.410037","last_unstale":"2024-03-24 10:39:21.751900","last_undegraded":"2024-03-24 10:39:21.751900","last_fullsized":"2024-03-24 10:39:21.751900","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722808","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:21.722808","last_peered":"2024-03-24 10:39:21.722808","last_clean":"2024-03-24 10:39:21.722808","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:21.722808","last_undegraded":"2024-03-24 10:39:21.722808","last_fullsized":"2024-03-24 10:39:21.722808","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721775","last_change":"2024-03-24 10:39:21.405373","last_active":"2024-03-24 10:39:21.721775","last_peered":"2024-03-24 10:39:21.721775","last_clean":"2024-03-24 10:39:21.721775","last_became_active":"2024-03-24 10:39:21.404592","last_became_peered":"2024-03-24 10:39:21.404592","last_unstale":"2024-03-24 10:39:21.721775","last_undegraded":"2024-03-24 10:39:21.721775","last_fullsized":"2024-03-24 10:39:21.721775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745772","last_change":"2024-03-24 10:39:21.736241","last_active":"2024-03-24 10:39:21.745772","last_peered":"2024-03-24 10:39:21.745772","last_clean":"2024-03-24 10:39:21.745772","last_became_active":"2024-03-24 10:39:21.732484","last_became_peered":"2024-03-24 10:39:21.732484","last_unstale":"2024-03-24 10:39:21.745772","last_undegraded":"2024-03-24 10:39:21.745772","last_fullsized":"2024-03-24 10:39:21.745772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726569","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:21.726569","last_peered":"2024-03-24 10:39:21.726569","last_clean":"2024-03-24 10:39:21.726569","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:21.726569","last_undegraded":"2024-03-24 10:39:21.726569","last_fullsized":"2024-03-24 10:39:21.726569","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715418","last_change":"2024-03-24 10:39:21.386180","last_active":"2024-03-24 10:39:21.715418","last_peered":"2024-03-24 10:39:21.715418","last_clean":"2024-03-24 10:39:21.715418","last_became_active":"2024-03-24 10:39:21.385860","last_became_peered":"2024-03-24 10:39:21.385860","last_unstale":"2024-03-24 10:39:21.715418","last_undegraded":"2024-03-24 10:39:21.715418","last_fullsized":"2024-03-24 10:39:21.715418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743840","last_change":"2024-03-24 10:39:21.733305","last_active":"2024-03-24 10:39:21.743840","last_peered":"2024-03-24 10:39:21.743840","last_clean":"2024-03-24 10:39:21.743840","last_became_active":"2024-03-24 10:39:21.732991","last_became_peered":"2024-03-24 10:39:21.732991","last_unstale":"2024-03-24 10:39:21.743840","last_undegraded":"2024-03-24 10:39:21.743840","last_fullsized":"2024-03-24 10:39:21.743840","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.720076","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:21.720076","last_peered":"2024-03-24 10:39:21.720076","last_clean":"2024-03-24 10:39:21.720076","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:21.720076","last_undegraded":"2024-03-24 10:39:21.720076","last_fullsized":"2024-03-24 10:39:21.720076","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722676","last_change":"2024-03-24 10:39:21.410670","last_active":"2024-03-24 10:39:21.722676","last_peered":"2024-03-24 10:39:21.722676","last_clean":"2024-03-24 10:39:21.722676","last_became_active":"2024-03-24 10:39:21.410239","last_became_peered":"2024-03-24 10:39:21.410239","last_unstale":"2024-03-24 10:39:21.722676","last_undegraded":"2024-03-24 10:39:21.722676","last_fullsized":"2024-03-24 10:39:21.722676","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744919","last_change":"2024-03-24 10:39:21.734952","last_active":"2024-03-24 10:39:21.744919","last_peered":"2024-03-24 10:39:21.744919","last_clean":"2024-03-24 10:39:21.744919","last_became_active":"2024-03-24 10:39:21.734666","last_became_peered":"2024-03-24 10:39:21.734666","last_unstale":"2024-03-24 10:39:21.744919","last_undegraded":"2024-03-24 10:39:21.744919","last_fullsized":"2024-03-24 10:39:21.744919","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724151","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:21.724151","last_peered":"2024-03-24 10:39:21.724151","last_clean":"2024-03-24 10:39:21.724151","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:21.724151","last_undegraded":"2024-03-24 10:39:21.724151","last_fullsized":"2024-03-24 10:39:21.724151","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722647","last_change":"2024-03-24 10:39:21.406436","last_active":"2024-03-24 10:39:21.722647","last_peered":"2024-03-24 10:39:21.722647","last_clean":"2024-03-24 10:39:21.722647","last_became_active":"2024-03-24 10:39:21.406101","last_became_peered":"2024-03-24 10:39:21.406101","last_unstale":"2024-03-24 10:39:21.722647","last_undegraded":"2024-03-24 10:39:21.722647","last_fullsized":"2024-03-24 10:39:21.722647","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737910","last_change":"2024-03-24 10:39:21.731561","last_active":"2024-03-24 10:39:21.737910","last_peered":"2024-03-24 10:39:21.737910","last_clean":"2024-03-24 10:39:21.737910","last_became_active":"2024-03-24 10:39:21.730998","last_became_peered":"2024-03-24 10:39:21.730998","last_unstale":"2024-03-24 10:39:21.737910","last_undegraded":"2024-03-24 10:39:21.737910","last_fullsized":"2024-03-24 10:39:21.737910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.727104","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:21.727104","last_peered":"2024-03-24 10:39:21.727104","last_clean":"2024-03-24 10:39:21.727104","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:21.727104","last_undegraded":"2024-03-24 10:39:21.727104","last_fullsized":"2024-03-24 10:39:21.727104","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726454","last_change":"2024-03-24 10:39:21.407528","last_active":"2024-03-24 10:39:21.726454","last_peered":"2024-03-24 10:39:21.726454","last_clean":"2024-03-24 10:39:21.726454","last_became_active":"2024-03-24 10:39:21.407090","last_became_peered":"2024-03-24 10:39:21.407090","last_unstale":"2024-03-24 10:39:21.726454","last_undegraded":"2024-03-24 10:39:21.726454","last_fullsized":"2024-03-24 10:39:21.726454","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745252","last_change":"2024-03-24 10:39:21.737964","last_active":"2024-03-24 10:39:21.745252","last_peered":"2024-03-24 10:39:21.745252","last_clean":"2024-03-24 10:39:21.745252","last_became_active":"2024-03-24 10:39:21.736699","last_became_peered":"2024-03-24 10:39:21.736699","last_unstale":"2024-03-24 10:39:21.745252","last_undegraded":"2024-03-24 10:39:21.745252","last_fullsized":"2024-03-24 10:39:21.745252","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724662","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:21.724662","last_peered":"2024-03-24 10:39:21.724662","last_clean":"2024-03-24 10:39:21.724662","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:21.724662","last_undegraded":"2024-03-24 10:39:21.724662","last_fullsized":"2024-03-24 10:39:21.724662","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723118","last_change":"2024-03-24 10:39:21.402542","last_active":"2024-03-24 10:39:21.723118","last_peered":"2024-03-24 10:39:21.723118","last_clean":"2024-03-24 10:39:21.723118","last_became_active":"2024-03-24 10:39:21.402228","last_became_peered":"2024-03-24 10:39:21.402228","last_unstale":"2024-03-24 10:39:21.723118","last_undegraded":"2024-03-24 10:39:21.723118","last_fullsized":"2024-03-24 10:39:21.723118","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738540","last_change":"2024-03-24 10:39:21.730414","last_active":"2024-03-24 10:39:21.738540","last_peered":"2024-03-24 10:39:21.738540","last_clean":"2024-03-24 10:39:21.738540","last_became_active":"2024-03-24 10:39:21.730157","last_became_peered":"2024-03-24 10:39:21.730157","last_unstale":"2024-03-24 10:39:21.738540","last_undegraded":"2024-03-24 10:39:21.738540","last_fullsized":"2024-03-24 10:39:21.738540","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756740","last_change":"2024-03-24 10:39:21.753593","last_active":"2024-03-24 10:39:21.756740","last_peered":"2024-03-24 10:39:21.756740","last_clean":"2024-03-24 10:39:21.756740","last_became_active":"2024-03-24 10:39:21.753209","last_became_peered":"2024-03-24 10:39:21.753209","last_unstale":"2024-03-24 10:39:21.756740","last_undegraded":"2024-03-24 10:39:21.756740","last_fullsized":"2024-03-24 10:39:21.756740","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729205","last_change":"2024-03-24 10:39:21.403995","last_active":"2024-03-24 10:39:21.729205","last_peered":"2024-03-24 10:39:21.729205","last_clean":"2024-03-24 10:39:21.729205","last_became_active":"2024-03-24 10:39:21.403652","last_became_peered":"2024-03-24 10:39:21.403652","last_unstale":"2024-03-24 10:39:21.729205","last_undegraded":"2024-03-24 10:39:21.729205","last_fullsized":"2024-03-24 10:39:21.729205","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745272","last_change":"2024-03-24 10:39:21.738871","last_active":"2024-03-24 10:39:21.745272","last_peered":"2024-03-24 10:39:21.745272","last_clean":"2024-03-24 10:39:21.745272","last_became_active":"2024-03-24 10:39:21.738567","last_became_peered":"2024-03-24 10:39:21.738567","last_unstale":"2024-03-24 10:39:21.745272","last_undegraded":"2024-03-24 10:39:21.745272","last_fullsized":"2024-03-24 10:39:21.745272","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748037","last_change":"2024-03-24 10:39:21.402898","last_active":"2024-03-24 10:39:21.748037","last_peered":"2024-03-24 10:39:21.748037","last_clean":"2024-03-24 10:39:21.748037","last_became_active":"2024-03-24 10:39:21.402655","last_became_peered":"2024-03-24 10:39:21.402655","last_unstale":"2024-03-24 10:39:21.748037","last_undegraded":"2024-03-24 10:39:21.748037","last_fullsized":"2024-03-24 10:39:21.748037","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747775","last_change":"2024-03-24 10:39:21.741510","last_active":"2024-03-24 10:39:21.747775","last_peered":"2024-03-24 10:39:21.747775","last_clean":"2024-03-24 10:39:21.747775","last_became_active":"2024-03-24 10:39:21.740907","last_became_peered":"2024-03-24 10:39:21.740907","last_unstale":"2024-03-24 10:39:21.747775","last_undegraded":"2024-03-24 10:39:21.747775","last_fullsized":"2024-03-24 10:39:21.747775","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752967","last_change":"2024-03-24 10:39:21.406729","last_active":"2024-03-24 10:39:21.752967","last_peered":"2024-03-24 10:39:21.752967","last_clean":"2024-03-24 10:39:21.752967","last_became_active":"2024-03-24 10:39:21.406428","last_became_peered":"2024-03-24 10:39:21.406428","last_unstale":"2024-03-24 10:39:21.752967","last_undegraded":"2024-03-24 10:39:21.752967","last_fullsized":"2024-03-24 10:39:21.752967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751571","last_change":"2024-03-24 10:39:21.750478","last_active":"2024-03-24 10:39:21.751571","last_peered":"2024-03-24 10:39:21.751571","last_clean":"2024-03-24 10:39:21.751571","last_became_active":"2024-03-24 10:39:21.750180","last_became_peered":"2024-03-24 10:39:21.750180","last_unstale":"2024-03-24 10:39:21.751571","last_undegraded":"2024-03-24 10:39:21.751571","last_fullsized":"2024-03-24 10:39:21.751571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.753802","last_change":"2024-03-24 10:39:21.411578","last_active":"2024-03-24 10:39:21.753802","last_peered":"2024-03-24 10:39:21.753802","last_clean":"2024-03-24 10:39:21.753802","last_became_active":"2024-03-24 10:39:21.410949","last_became_peered":"2024-03-24 10:39:21.410949","last_unstale":"2024-03-24 10:39:21.753802","last_undegraded":"2024-03-24 10:39:21.753802","last_fullsized":"2024-03-24 10:39:21.753802","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738381","last_change":"2024-03-24 10:39:21.729490","last_active":"2024-03-24 10:39:21.738381","last_peered":"2024-03-24 10:39:21.738381","last_clean":"2024-03-24 10:39:21.738381","last_became_active":"2024-03-24 10:39:21.729213","last_became_peered":"2024-03-24 10:39:21.729213","last_unstale":"2024-03-24 10:39:21.738381","last_undegraded":"2024-03-24 10:39:21.738381","last_fullsized":"2024-03-24 10:39:21.738381","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722050","last_change":"2024-03-24 10:39:21.405449","last_active":"2024-03-24 10:39:21.722050","last_peered":"2024-03-24 10:39:21.722050","last_clean":"2024-03-24 10:39:21.722050","last_became_active":"2024-03-24 10:39:21.404858","last_became_peered":"2024-03-24 10:39:21.404858","last_unstale":"2024-03-24 10:39:21.722050","last_undegraded":"2024-03-24 10:39:21.722050","last_fullsized":"2024-03-24 10:39:21.722050","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744150","last_change":"2024-03-24 10:39:21.734494","last_active":"2024-03-24 10:39:21.744150","last_peered":"2024-03-24 10:39:21.744150","last_clean":"2024-03-24 10:39:21.744150","last_became_active":"2024-03-24 10:39:21.734226","last_became_peered":"2024-03-24 10:39:21.734226","last_unstale":"2024-03-24 10:39:21.744150","last_undegraded":"2024-03-24 10:39:21.744150","last_fullsized":"2024-03-24 10:39:21.744150","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715521","last_change":"2024-03-24 10:39:21.393879","last_active":"2024-03-24 10:39:21.715521","last_peered":"2024-03-24 10:39:21.715521","last_clean":"2024-03-24 10:39:21.715521","last_became_active":"2024-03-24 10:39:21.393571","last_became_peered":"2024-03-24 10:39:21.393571","last_unstale":"2024-03-24 10:39:21.715521","last_undegraded":"2024-03-24 10:39:21.715521","last_fullsized":"2024-03-24 10:39:21.715521","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756857","last_change":"2024-03-24 10:39:21.754801","last_active":"2024-03-24 10:39:21.756857","last_peered":"2024-03-24 10:39:21.756857","last_clean":"2024-03-24 10:39:21.756857","last_became_active":"2024-03-24 10:39:21.754290","last_became_peered":"2024-03-24 10:39:21.754290","last_unstale":"2024-03-24 10:39:21.756857","last_undegraded":"2024-03-24 10:39:21.756857","last_fullsized":"2024-03-24 10:39:21.756857","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722857","last_change":"2024-03-24 10:39:21.413325","last_active":"2024-03-24 10:39:21.722857","last_peered":"2024-03-24 10:39:21.722857","last_clean":"2024-03-24 10:39:21.722857","last_became_active":"2024-03-24 10:39:21.412968","last_became_peered":"2024-03-24 10:39:21.412968","last_unstale":"2024-03-24 10:39:21.722857","last_undegraded":"2024-03-24 10:39:21.722857","last_fullsized":"2024-03-24 10:39:21.722857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750074","last_change":"2024-03-24 10:39:21.749344","last_active":"2024-03-24 10:39:21.750074","last_peered":"2024-03-24 10:39:21.750074","last_clean":"2024-03-24 10:39:21.750074","last_became_active":"2024-03-24 10:39:21.748994","last_became_peered":"2024-03-24 10:39:21.748994","last_unstale":"2024-03-24 10:39:21.750074","last_undegraded":"2024-03-24 10:39:21.750074","last_fullsized":"2024-03-24 10:39:21.750074","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723365","last_change":"2024-03-24 10:39:21.406440","last_active":"2024-03-24 10:39:21.723365","last_peered":"2024-03-24 10:39:21.723365","last_clean":"2024-03-24 10:39:21.723365","last_became_active":"2024-03-24 10:39:21.406223","last_became_peered":"2024-03-24 10:39:21.406223","last_unstale":"2024-03-24 10:39:21.723365","last_undegraded":"2024-03-24 10:39:21.723365","last_fullsized":"2024-03-24 10:39:21.723365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744941","last_change":"2024-03-24 10:39:21.735015","last_active":"2024-03-24 10:39:21.744941","last_peered":"2024-03-24 10:39:21.744941","last_clean":"2024-03-24 10:39:21.744941","last_became_active":"2024-03-24 10:39:21.734736","last_became_peered":"2024-03-24 10:39:21.734736","last_unstale":"2024-03-24 10:39:21.744941","last_undegraded":"2024-03-24 10:39:21.744941","last_fullsized":"2024-03-24 10:39:21.744941","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723220","last_change":"2024-03-24 10:39:21.402419","last_active":"2024-03-24 10:39:21.723220","last_peered":"2024-03-24 10:39:21.723220","last_clean":"2024-03-24 10:39:21.723220","last_became_active":"2024-03-24 10:39:21.402129","last_became_peered":"2024-03-24 10:39:21.402129","last_unstale":"2024-03-24 10:39:21.723220","last_undegraded":"2024-03-24 10:39:21.723220","last_fullsized":"2024-03-24 10:39:21.723220","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756584","last_change":"2024-03-24 10:39:21.752207","last_active":"2024-03-24 10:39:21.756584","last_peered":"2024-03-24 10:39:21.756584","last_clean":"2024-03-24 10:39:21.756584","last_became_active":"2024-03-24 10:39:21.751891","last_became_peered":"2024-03-24 10:39:21.751891","last_unstale":"2024-03-24 10:39:21.756584","last_undegraded":"2024-03-24 10:39:21.756584","last_fullsized":"2024-03-24 10:39:21.756584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718129","last_change":"2024-03-24 10:39:21.396998","last_active":"2024-03-24 10:39:21.718129","last_peered":"2024-03-24 10:39:21.718129","last_clean":"2024-03-24 10:39:21.718129","last_became_active":"2024-03-24 10:39:21.396640","last_became_peered":"2024-03-24 10:39:21.396640","last_unstale":"2024-03-24 10:39:21.718129","last_undegraded":"2024-03-24 10:39:21.718129","last_fullsized":"2024-03-24 10:39:21.718129","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750006","last_change":"2024-03-24 10:39:21.747974","last_active":"2024-03-24 10:39:21.750006","last_peered":"2024-03-24 10:39:21.750006","last_clean":"2024-03-24 10:39:21.750006","last_became_active":"2024-03-24 10:39:21.742188","last_became_peered":"2024-03-24 10:39:21.742188","last_unstale":"2024-03-24 10:39:21.750006","last_undegraded":"2024-03-24 10:39:21.750006","last_fullsized":"2024-03-24 10:39:21.750006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-03-24 10:39:23.028062","last_change":"2024-03-24 10:39:21.412507","last_active":"2024-03-24 10:39:23.028062","last_peered":"2024-03-24 10:39:23.028062","last_clean":"2024-03-24 10:39:23.028062","last_became_active":"2024-03-24 10:39:21.412194","last_became_peered":"2024-03-24 10:39:21.412194","last_unstale":"2024-03-24 10:39:23.028062","last_undegraded":"2024-03-24 10:39:23.028062","last_fullsized":"2024-03-24 10:39:23.028062","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755163","last_change":"2024-03-24 10:39:21.751687","last_active":"2024-03-24 10:39:21.755163","last_peered":"2024-03-24 10:39:21.755163","last_clean":"2024-03-24 10:39:21.755163","last_became_active":"2024-03-24 10:39:21.751067","last_became_peered":"2024-03-24 10:39:21.751067","last_unstale":"2024-03-24 10:39:21.755163","last_undegraded":"2024-03-24 10:39:21.755163","last_fullsized":"2024-03-24 10:39:21.755163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726350","last_change":"2024-03-24 10:39:21.409431","last_active":"2024-03-24 10:39:21.726350","last_peered":"2024-03-24 10:39:21.726350","last_clean":"2024-03-24 10:39:21.726350","last_became_active":"2024-03-24 10:39:21.409077","last_became_peered":"2024-03-24 10:39:21.409077","last_unstale":"2024-03-24 10:39:21.726350","last_undegraded":"2024-03-24 10:39:21.726350","last_fullsized":"2024-03-24 10:39:21.726350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748566","last_change":"2024-03-24 10:39:21.746704","last_active":"2024-03-24 10:39:21.748566","last_peered":"2024-03-24 10:39:21.748566","last_clean":"2024-03-24 10:39:21.748566","last_became_active":"2024-03-24 10:39:21.746288","last_became_peered":"2024-03-24 10:39:21.746288","last_unstale":"2024-03-24 10:39:21.748566","last_undegraded":"2024-03-24 10:39:21.748566","last_fullsized":"2024-03-24 10:39:21.748566","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722735","last_change":"2024-03-24 10:39:21.405622","last_active":"2024-03-24 10:39:21.722735","last_peered":"2024-03-24 10:39:21.722735","last_clean":"2024-03-24 10:39:21.722735","last_became_active":"2024-03-24 10:39:21.405031","last_became_peered":"2024-03-24 10:39:21.405031","last_unstale":"2024-03-24 10:39:21.722735","last_undegraded":"2024-03-24 10:39:21.722735","last_fullsized":"2024-03-24 10:39:21.722735","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749673","last_change":"2024-03-24 10:39:21.747203","last_active":"2024-03-24 10:39:21.749673","last_peered":"2024-03-24 10:39:21.749673","last_clean":"2024-03-24 10:39:21.749673","last_became_active":"2024-03-24 10:39:21.746669","last_became_peered":"2024-03-24 10:39:21.746669","last_unstale":"2024-03-24 10:39:21.749673","last_undegraded":"2024-03-24 10:39:21.749673","last_fullsized":"2024-03-24 10:39:21.749673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722465","last_change":"2024-03-24 10:39:21.401363","last_active":"2024-03-24 10:39:21.722465","last_peered":"2024-03-24 10:39:21.722465","last_clean":"2024-03-24 10:39:21.722465","last_became_active":"2024-03-24 10:39:21.401068","last_became_peered":"2024-03-24 10:39:21.401068","last_unstale":"2024-03-24 10:39:21.722465","last_undegraded":"2024-03-24 10:39:21.722465","last_fullsized":"2024-03-24 10:39:21.722465","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737930","last_change":"2024-03-24 10:39:21.731704","last_active":"2024-03-24 10:39:21.737930","last_peered":"2024-03-24 10:39:21.737930","last_clean":"2024-03-24 10:39:21.737930","last_became_active":"2024-03-24 10:39:21.731209","last_became_peered":"2024-03-24 10:39:21.731209","last_unstale":"2024-03-24 10:39:21.737930","last_undegraded":"2024-03-24 10:39:21.737930","last_fullsized":"2024-03-24 10:39:21.737930","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725064","last_change":"2024-03-24 10:39:21.396241","last_active":"2024-03-24 10:39:21.725064","last_peered":"2024-03-24 10:39:21.725064","last_clean":"2024-03-24 10:39:21.725064","last_became_active":"2024-03-24 10:39:21.395775","last_became_peered":"2024-03-24 10:39:21.395775","last_unstale":"2024-03-24 10:39:21.725064","last_undegraded":"2024-03-24 10:39:21.725064","last_fullsized":"2024-03-24 10:39:21.725064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745178","last_change":"2024-03-24 10:39:21.738160","last_active":"2024-03-24 10:39:21.745178","last_peered":"2024-03-24 10:39:21.745178","last_clean":"2024-03-24 10:39:21.745178","last_became_active":"2024-03-24 10:39:21.737855","last_became_peered":"2024-03-24 10:39:21.737855","last_unstale":"2024-03-24 10:39:21.745178","last_undegraded":"2024-03-24 10:39:21.745178","last_fullsized":"2024-03-24 10:39:21.745178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750738","last_change":"2024-03-24 10:39:21.398871","last_active":"2024-03-24 10:39:21.750738","last_peered":"2024-03-24 10:39:21.750738","last_clean":"2024-03-24 10:39:21.750738","last_became_active":"2024-03-24 10:39:21.398558","last_became_peered":"2024-03-24 10:39:21.398558","last_unstale":"2024-03-24 10:39:21.750738","last_undegraded":"2024-03-24 10:39:21.750738","last_fullsized":"2024-03-24 10:39:21.750738","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748448","last_change":"2024-03-24 10:39:21.746721","last_active":"2024-03-24 10:39:21.748448","last_peered":"2024-03-24 10:39:21.748448","last_clean":"2024-03-24 10:39:21.748448","last_became_active":"2024-03-24 10:39:21.746369","last_became_peered":"2024-03-24 10:39:21.746369","last_unstale":"2024-03-24 10:39:21.748448","last_undegraded":"2024-03-24 10:39:21.748448","last_fullsized":"2024-03-24 10:39:21.748448","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716479","last_change":"2024-03-24 10:39:21.397102","last_active":"2024-03-24 10:39:21.716479","last_peered":"2024-03-24 10:39:21.716479","last_clean":"2024-03-24 10:39:21.716479","last_became_active":"2024-03-24 10:39:21.396712","last_became_peered":"2024-03-24 10:39:21.396712","last_unstale":"2024-03-24 10:39:21.716479","last_undegraded":"2024-03-24 10:39:21.716479","last_fullsized":"2024-03-24 10:39:21.716479","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748075","last_change":"2024-03-24 10:39:21.742483","last_active":"2024-03-24 10:39:21.748075","last_peered":"2024-03-24 10:39:21.748075","last_clean":"2024-03-24 10:39:21.748075","last_became_active":"2024-03-24 10:39:21.740541","last_became_peered":"2024-03-24 10:39:21.740541","last_unstale":"2024-03-24 10:39:21.748075","last_undegraded":"2024-03-24 10:39:21.748075","last_fullsized":"2024-03-24 10:39:21.748075","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750097","last_change":"2024-03-24 10:39:21.411702","last_active":"2024-03-24 10:39:21.750097","last_peered":"2024-03-24 10:39:21.750097","last_clean":"2024-03-24 10:39:21.750097","last_became_active":"2024-03-24 10:39:21.410083","last_became_peered":"2024-03-24 10:39:21.410083","last_unstale":"2024-03-24 10:39:21.750097","last_undegraded":"2024-03-24 10:39:21.750097","last_fullsized":"2024-03-24 10:39:21.750097","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750114","last_change":"2024-03-24 10:39:21.749409","last_active":"2024-03-24 10:39:21.750114","last_peered":"2024-03-24 10:39:21.750114","last_clean":"2024-03-24 10:39:21.750114","last_became_active":"2024-03-24 10:39:21.749109","last_became_peered":"2024-03-24 10:39:21.749109","last_unstale":"2024-03-24 10:39:21.750114","last_undegraded":"2024-03-24 10:39:21.750114","last_fullsized":"2024-03-24 10:39:21.750114","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724400","last_change":"2024-03-24 10:39:21.400428","last_active":"2024-03-24 10:39:21.724400","last_peered":"2024-03-24 10:39:21.724400","last_clean":"2024-03-24 10:39:21.724400","last_became_active":"2024-03-24 10:39:21.400131","last_became_peered":"2024-03-24 10:39:21.400131","last_unstale":"2024-03-24 10:39:21.724400","last_undegraded":"2024-03-24 10:39:21.724400","last_fullsized":"2024-03-24 10:39:21.724400","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744265","last_change":"2024-03-24 10:39:21.735779","last_active":"2024-03-24 10:39:21.744265","last_peered":"2024-03-24 10:39:21.744265","last_clean":"2024-03-24 10:39:21.744265","last_became_active":"2024-03-24 10:39:21.735484","last_became_peered":"2024-03-24 10:39:21.735484","last_unstale":"2024-03-24 10:39:21.744265","last_undegraded":"2024-03-24 10:39:21.744265","last_fullsized":"2024-03-24 10:39:21.744265","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726445","last_change":"2024-03-24 10:39:21.411540","last_active":"2024-03-24 10:39:21.726445","last_peered":"2024-03-24 10:39:21.726445","last_clean":"2024-03-24 10:39:21.726445","last_became_active":"2024-03-24 10:39:21.410761","last_became_peered":"2024-03-24 10:39:21.410761","last_unstale":"2024-03-24 10:39:21.726445","last_undegraded":"2024-03-24 10:39:21.726445","last_fullsized":"2024-03-24 10:39:21.726445","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744906","last_change":"2024-03-24 10:39:21.736699","last_active":"2024-03-24 10:39:21.744906","last_peered":"2024-03-24 10:39:21.744906","last_clean":"2024-03-24 10:39:21.744906","last_became_active":"2024-03-24 10:39:21.736384","last_became_peered":"2024-03-24 10:39:21.736384","last_unstale":"2024-03-24 10:39:21.744906","last_undegraded":"2024-03-24 10:39:21.744906","last_fullsized":"2024-03-24 10:39:21.744906","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747414","last_change":"2024-03-24 10:39:21.398063","last_active":"2024-03-24 10:39:21.747414","last_peered":"2024-03-24 10:39:21.747414","last_clean":"2024-03-24 10:39:21.747414","last_became_active":"2024-03-24 10:39:21.397278","last_became_peered":"2024-03-24 10:39:21.397278","last_unstale":"2024-03-24 10:39:21.747414","last_undegraded":"2024-03-24 10:39:21.747414","last_fullsized":"2024-03-24 10:39:21.747414","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749692","last_change":"2024-03-24 10:39:21.747336","last_active":"2024-03-24 10:39:21.749692","last_peered":"2024-03-24 10:39:21.749692","last_clean":"2024-03-24 10:39:21.749692","last_became_active":"2024-03-24 10:39:21.746919","last_became_peered":"2024-03-24 10:39:21.746919","last_unstale":"2024-03-24 10:39:21.749692","last_undegraded":"2024-03-24 10:39:21.749692","last_fullsized":"2024-03-24 10:39:21.749692","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725976","last_change":"2024-03-24 10:39:21.404083","last_active":"2024-03-24 10:39:21.725976","last_peered":"2024-03-24 10:39:21.725976","last_clean":"2024-03-24 10:39:21.725976","last_became_active":"2024-03-24 10:39:21.403747","last_became_peered":"2024-03-24 10:39:21.403747","last_unstale":"2024-03-24 10:39:21.725976","last_undegraded":"2024-03-24 10:39:21.725976","last_fullsized":"2024-03-24 10:39:21.725976","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750584","last_change":"2024-03-24 10:39:21.749778","last_active":"2024-03-24 10:39:21.750584","last_peered":"2024-03-24 10:39:21.750584","last_clean":"2024-03-24 10:39:21.750584","last_became_active":"2024-03-24 10:39:21.749344","last_became_peered":"2024-03-24 10:39:21.749344","last_unstale":"2024-03-24 10:39:21.750584","last_undegraded":"2024-03-24 10:39:21.750584","last_fullsized":"2024-03-24 10:39:21.750584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715463","last_change":"2024-03-24 10:39:21.394117","last_active":"2024-03-24 10:39:21.715463","last_peered":"2024-03-24 10:39:21.715463","last_clean":"2024-03-24 10:39:21.715463","last_became_active":"2024-03-24 10:39:21.390303","last_became_peered":"2024-03-24 10:39:21.390303","last_unstale":"2024-03-24 10:39:21.715463","last_undegraded":"2024-03-24 10:39:21.715463","last_fullsized":"2024-03-24 10:39:21.715463","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747294","last_change":"2024-03-24 10:39:21.738700","last_active":"2024-03-24 10:39:21.747294","last_peered":"2024-03-24 10:39:21.747294","last_clean":"2024-03-24 10:39:21.747294","last_became_active":"2024-03-24 10:39:21.738406","last_became_peered":"2024-03-24 10:39:21.738406","last_unstale":"2024-03-24 10:39:21.747294","last_undegraded":"2024-03-24 10:39:21.747294","last_fullsized":"2024-03-24 10:39:21.747294","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744340","last_change":"2024-03-24 10:39:21.392998","last_active":"2024-03-24 10:39:21.744340","last_peered":"2024-03-24 10:39:21.744340","last_clean":"2024-03-24 10:39:21.744340","last_became_active":"2024-03-24 10:39:21.392663","last_became_peered":"2024-03-24 10:39:21.392663","last_unstale":"2024-03-24 10:39:21.744340","last_undegraded":"2024-03-24 10:39:21.744340","last_fullsized":"2024-03-24 10:39:21.744340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749623","last_change":"2024-03-24 10:39:21.748045","last_active":"2024-03-24 10:39:21.749623","last_peered":"2024-03-24 10:39:21.749623","last_clean":"2024-03-24 10:39:21.749623","last_became_active":"2024-03-24 10:39:21.747686","last_became_peered":"2024-03-24 10:39:21.747686","last_unstale":"2024-03-24 10:39:21.749623","last_undegraded":"2024-03-24 10:39:21.749623","last_fullsized":"2024-03-24 10:39:21.749623","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756879","last_change":"2024-03-24 10:39:21.405112","last_active":"2024-03-24 10:39:21.756879","last_peered":"2024-03-24 10:39:21.756879","last_clean":"2024-03-24 10:39:21.756879","last_became_active":"2024-03-24 10:39:21.404792","last_became_peered":"2024-03-24 10:39:21.404792","last_unstale":"2024-03-24 10:39:21.756879","last_undegraded":"2024-03-24 10:39:21.756879","last_fullsized":"2024-03-24 10:39:21.756879","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748245","last_change":"2024-03-24 10:39:21.741272","last_active":"2024-03-24 10:39:21.748245","last_peered":"2024-03-24 10:39:21.748245","last_clean":"2024-03-24 10:39:21.748245","last_became_active":"2024-03-24 10:39:21.740190","last_became_peered":"2024-03-24 10:39:21.740190","last_unstale":"2024-03-24 10:39:21.748245","last_undegraded":"2024-03-24 10:39:21.748245","last_fullsized":"2024-03-24 10:39:21.748245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723769","last_change":"2024-03-24 10:39:21.407652","last_active":"2024-03-24 10:39:21.723769","last_peered":"2024-03-24 10:39:21.723769","last_clean":"2024-03-24 10:39:21.723769","last_became_active":"2024-03-24 10:39:21.407281","last_became_peered":"2024-03-24 10:39:21.407281","last_unstale":"2024-03-24 10:39:21.723769","last_undegraded":"2024-03-24 10:39:21.723769","last_fullsized":"2024-03-24 10:39:21.723769","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744581","last_change":"2024-03-24 10:39:21.734684","last_active":"2024-03-24 10:39:21.744581","last_peered":"2024-03-24 10:39:21.744581","last_clean":"2024-03-24 10:39:21.744581","last_became_active":"2024-03-24 10:39:21.734378","last_became_peered":"2024-03-24 10:39:21.734378","last_unstale":"2024-03-24 10:39:21.744581","last_undegraded":"2024-03-24 10:39:21.744581","last_fullsized":"2024-03-24 10:39:21.744581","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724208","last_change":"2024-03-24 10:39:21.400591","last_active":"2024-03-24 10:39:21.724208","last_peered":"2024-03-24 10:39:21.724208","last_clean":"2024-03-24 10:39:21.724208","last_became_active":"2024-03-24 10:39:21.400291","last_became_peered":"2024-03-24 10:39:21.400291","last_unstale":"2024-03-24 10:39:21.724208","last_undegraded":"2024-03-24 10:39:21.724208","last_fullsized":"2024-03-24 10:39:21.724208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.734103","last_change":"2024-03-24 10:39:21.728699","last_active":"2024-03-24 10:39:21.734103","last_peered":"2024-03-24 10:39:21.734103","last_clean":"2024-03-24 10:39:21.734103","last_became_active":"2024-03-24 10:39:21.728399","last_became_peered":"2024-03-24 10:39:21.728399","last_unstale":"2024-03-24 10:39:21.734103","last_undegraded":"2024-03-24 10:39:21.734103","last_fullsized":"2024-03-24 10:39:21.734103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737300","last_change":"2024-03-24 10:39:21.389698","last_active":"2024-03-24 10:39:21.737300","last_peered":"2024-03-24 10:39:21.737300","last_clean":"2024-03-24 10:39:21.737300","last_became_active":"2024-03-24 10:39:21.389371","last_became_peered":"2024-03-24 10:39:21.389371","last_unstale":"2024-03-24 10:39:21.737300","last_undegraded":"2024-03-24 10:39:21.737300","last_fullsized":"2024-03-24 10:39:21.737300","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745793","last_change":"2024-03-24 10:39:21.736640","last_active":"2024-03-24 10:39:21.745793","last_peered":"2024-03-24 10:39:21.745793","last_clean":"2024-03-24 10:39:21.745793","last_became_active":"2024-03-24 10:39:21.736337","last_became_peered":"2024-03-24 10:39:21.736337","last_unstale":"2024-03-24 10:39:21.745793","last_undegraded":"2024-03-24 10:39:21.745793","last_fullsized":"2024-03-24 10:39:21.745793","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725719","last_change":"2024-03-24 10:39:21.398253","last_active":"2024-03-24 10:39:21.725719","last_peered":"2024-03-24 10:39:21.725719","last_clean":"2024-03-24 10:39:21.725719","last_became_active":"2024-03-24 10:39:21.397537","last_became_peered":"2024-03-24 10:39:21.397537","last_unstale":"2024-03-24 10:39:21.725719","last_undegraded":"2024-03-24 10:39:21.725719","last_fullsized":"2024-03-24 10:39:21.725719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750751","last_change":"2024-03-24 10:39:21.749427","last_active":"2024-03-24 10:39:21.750751","last_peered":"2024-03-24 10:39:21.750751","last_clean":"2024-03-24 10:39:21.750751","last_became_active":"2024-03-24 10:39:21.749070","last_became_peered":"2024-03-24 10:39:21.749070","last_unstale":"2024-03-24 10:39:21.750751","last_undegraded":"2024-03-24 10:39:21.750751","last_fullsized":"2024-03-24 10:39:21.750751","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722365","last_change":"2024-03-24 10:39:21.401943","last_active":"2024-03-24 10:39:21.722365","last_peered":"2024-03-24 10:39:21.722365","last_clean":"2024-03-24 10:39:21.722365","last_became_active":"2024-03-24 10:39:21.396400","last_became_peered":"2024-03-24 10:39:21.396400","last_unstale":"2024-03-24 10:39:21.722365","last_undegraded":"2024-03-24 10:39:21.722365","last_fullsized":"2024-03-24 10:39:21.722365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737949","last_change":"2024-03-24 10:39:21.731745","last_active":"2024-03-24 10:39:21.737949","last_peered":"2024-03-24 10:39:21.737949","last_clean":"2024-03-24 10:39:21.737949","last_became_active":"2024-03-24 10:39:21.731419","last_became_peered":"2024-03-24 10:39:21.731419","last_unstale":"2024-03-24 10:39:21.737949","last_undegraded":"2024-03-24 10:39:21.737949","last_fullsized":"2024-03-24 10:39:21.737949","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750282","last_change":"2024-03-24 10:39:21.390586","last_active":"2024-03-24 10:39:21.750282","last_peered":"2024-03-24 10:39:21.750282","last_clean":"2024-03-24 10:39:21.750282","last_became_active":"2024-03-24 10:39:21.390097","last_became_peered":"2024-03-24 10:39:21.390097","last_unstale":"2024-03-24 10:39:21.750282","last_undegraded":"2024-03-24 10:39:21.750282","last_fullsized":"2024-03-24 10:39:21.750282","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744182","last_change":"2024-03-24 10:39:21.734074","last_active":"2024-03-24 10:39:21.744182","last_peered":"2024-03-24 10:39:21.744182","last_clean":"2024-03-24 10:39:21.744182","last_became_active":"2024-03-24 10:39:21.733775","last_became_peered":"2024-03-24 10:39:21.733775","last_unstale":"2024-03-24 10:39:21.744182","last_undegraded":"2024-03-24 10:39:21.744182","last_fullsized":"2024-03-24 10:39:21.744182","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.746919","last_change":"2024-03-24 10:39:21.403801","last_active":"2024-03-24 10:39:21.746919","last_peered":"2024-03-24 10:39:21.746919","last_clean":"2024-03-24 10:39:21.746919","last_became_active":"2024-03-24 10:39:21.403475","last_became_peered":"2024-03-24 10:39:21.403475","last_unstale":"2024-03-24 10:39:21.746919","last_undegraded":"2024-03-24 10:39:21.746919","last_fullsized":"2024-03-24 10:39:21.746919","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745647","last_change":"2024-03-24 10:39:21.735800","last_active":"2024-03-24 10:39:21.745647","last_peered":"2024-03-24 10:39:21.745647","last_clean":"2024-03-24 10:39:21.745647","last_became_active":"2024-03-24 10:39:21.735499","last_became_peered":"2024-03-24 10:39:21.735499","last_unstale":"2024-03-24 10:39:21.745647","last_undegraded":"2024-03-24 10:39:21.745647","last_fullsized":"2024-03-24 10:39:21.745647","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747151","last_change":"2024-03-24 10:39:21.398511","last_active":"2024-03-24 10:39:21.747151","last_peered":"2024-03-24 10:39:21.747151","last_clean":"2024-03-24 10:39:21.747151","last_became_active":"2024-03-24 10:39:21.397759","last_became_peered":"2024-03-24 10:39:21.397759","last_unstale":"2024-03-24 10:39:21.747151","last_undegraded":"2024-03-24 10:39:21.747151","last_fullsized":"2024-03-24 10:39:21.747151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.754786","last_change":"2024-03-24 10:39:21.750697","last_active":"2024-03-24 10:39:21.754786","last_peered":"2024-03-24 10:39:21.754786","last_clean":"2024-03-24 10:39:21.754786","last_became_active":"2024-03-24 10:39:21.750360","last_became_peered":"2024-03-24 10:39:21.750360","last_unstale":"2024-03-24 10:39:21.754786","last_undegraded":"2024-03-24 10:39:21.754786","last_fullsized":"2024-03-24 10:39:21.754786","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723664","last_change":"2024-03-24 10:39:21.404992","last_active":"2024-03-24 10:39:21.723664","last_peered":"2024-03-24 10:39:21.723664","last_clean":"2024-03-24 10:39:21.723664","last_became_active":"2024-03-24 10:39:21.404656","last_became_peered":"2024-03-24 10:39:21.404656","last_unstale":"2024-03-24 10:39:21.723664","last_undegraded":"2024-03-24 10:39:21.723664","last_fullsized":"2024-03-24 10:39:21.723664","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756515","last_change":"2024-03-24 10:39:21.753684","last_active":"2024-03-24 10:39:21.756515","last_peered":"2024-03-24 10:39:21.756515","last_clean":"2024-03-24 10:39:21.756515","last_became_active":"2024-03-24 10:39:21.753331","last_became_peered":"2024-03-24 10:39:21.753331","last_unstale":"2024-03-24 10:39:21.756515","last_undegraded":"2024-03-24 10:39:21.756515","last_fullsized":"2024-03-24 10:39:21.756515","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.730085","last_change":"2024-03-24 10:39:21.411354","last_active":"2024-03-24 10:39:21.730085","last_peered":"2024-03-24 10:39:21.730085","last_clean":"2024-03-24 10:39:21.730085","last_became_active":"2024-03-24 10:39:21.410898","last_became_peered":"2024-03-24 10:39:21.410898","last_unstale":"2024-03-24 10:39:21.730085","last_undegraded":"2024-03-24 10:39:21.730085","last_fullsized":"2024-03-24 10:39:21.730085","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737268","last_change":"2024-03-24 10:39:21.731852","last_active":"2024-03-24 10:39:21.737268","last_peered":"2024-03-24 10:39:21.737268","last_clean":"2024-03-24 10:39:21.737268","last_became_active":"2024-03-24 10:39:21.731546","last_became_peered":"2024-03-24 10:39:21.731546","last_unstale":"2024-03-24 10:39:21.737268","last_undegraded":"2024-03-24 10:39:21.737268","last_fullsized":"2024-03-24 10:39:21.737268","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748581","last_change":"2024-03-24 10:39:21.395928","last_active":"2024-03-24 10:39:21.748581","last_peered":"2024-03-24 10:39:21.748581","last_clean":"2024-03-24 10:39:21.748581","last_became_active":"2024-03-24 10:39:21.395582","last_became_peered":"2024-03-24 10:39:21.395582","last_unstale":"2024-03-24 10:39:21.748581","last_undegraded":"2024-03-24 10:39:21.748581","last_fullsized":"2024-03-24 10:39:21.748581","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]}]}} 2024-03-24T10:39:29.160 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-24T10:39:29.160 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-24T10:39:29.160 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-24T10:39:29.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-24T10:39:29.161 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-24T10:39:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 Processor -- start 2024-03-24T10:39:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 -- start start 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 0x7fdd8410e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840f9230 con 0x7fdd840f1ec0 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8410ef10 con 0x7fdd840f2310 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8bb94700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841aa660 con 0x7fdd840f5920 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8898f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd83fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd89190700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 0x7fdd8410e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8898f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46350/0 (socket says 172.21.15.73:46350) 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd83fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56258/0 (socket says 172.21.15.73:56258) 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.322 7fdd8898f700 1 -- 172.21.15.73:0/1564253827 learned_addr learned my addr 172.21.15.73:0/1564253827 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 -- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 msgr2=0x7fdd840f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 -- 172.21.15.73:0/1564253827 >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 msgr2=0x7fdd8410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 --2- 172.21.15.73:0/1564253827 >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 -- 172.21.15.73:0/1564253827 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd841aa810 con 0x7fdd840f2310 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd83fff700 1 --2- 172.21.15.73:0/1564253827 >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd8898f700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd89190700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 0x7fdd8410e8e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd841037f0 tx=0x7fdd7c009d40).ready entity=mon.1 client_cookie=a5d6ca3fd997ac27 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd837fe700 1 -- 172.21.15.73:0/1564253827 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd841aa810 con 0x7fdd840f2310 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd837fe700 1 -- 172.21.15.73:0/1564253827 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00b7c0 con 0x7fdd840f2310 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd837fe700 1 -- 172.21.15.73:0/1564253827 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd7c00b9a0 con 0x7fdd840f2310 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd8bb94700 1 -- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 msgr2=0x7fdd8410e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.323 7fdd8bb94700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 0x7fdd8410e8e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd841037f0 tx=0x7fdd7c009d40).stop 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 -- 172.21.15.73:0/1564253827 shutdown_connections 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840f2310 0x7fdd8410e8e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 --2- 172.21.15.73:0/1564253827 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840f5920 0x7fdd840f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 --2- 172.21.15.73:0/1564253827 >> v2:172.21.15.73:3300/0 conn(0x7fdd840f1ec0 0x7fdd8410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 -- 172.21.15.73:0/1564253827 >> 172.21.15.73:0/1564253827 conn(0x7fdd84113a70 msgr2=0x7fdd840f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 -- 172.21.15.73:0/1564253827 shutdown_connections 2024-03-24T10:39:29.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.324 7fdd8bb94700 1 -- 172.21.15.73:0/1564253827 wait complete. 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.346 7fdd8bb94700 1 Processor -- start 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.346 7fdd8bb94700 1 -- start start 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 0x7fdd840d88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 0x7fdd841bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840be760 con 0x7fdd840cce50 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840d9ea0 con 0x7fdd840d8f00 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8bb94700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840d0380 con 0x7fdd840cc3d0 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd83fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 0x7fdd840d88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46358/0 (socket says 172.21.15.73:46358) 2024-03-24T10:39:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 -- 172.21.15.73:0/835576324 learned_addr learned my addr 172.21.15.73:0/835576324 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd89190700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 0x7fdd841bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 -- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 msgr2=0x7fdd841bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 0x7fdd841bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 -- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 msgr2=0x7fdd840d88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 0x7fdd840d88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 -- 172.21.15.73:0/835576324 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840d9350 con 0x7fdd840cc3d0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd83fff700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 0x7fdd840d88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd89190700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 0x7fdd841bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd8898f700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdd7800c000 tx=0x7fdd7800ea10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd840d9350 con 0x7fdd840cc3d0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.347 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78012600 con 0x7fdd840cc3d0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.348 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840d9670 con 0x7fdd840cc3d0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.348 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd7800f040 con 0x7fdd840cc3d0 2024-03-24T10:39:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.348 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841bc5e0 con 0x7fdd840cc3d0 2024-03-24T10:39:29.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.348 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdd78022060 con 0x7fdd840cc3d0 2024-03-24T10:39:29.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.348 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fdd78010040 con 0x7fdd840cc3d0 2024-03-24T10:39:29.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.349 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd840f08e0 con 0x7fdd840cc3d0 2024-03-24T10:39:29.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.352 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdd780123f0 con 0x7fdd840cc3d0 2024-03-24T10:39:29.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.476 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdd841aed80 con 0x7fdd840cc3d0 2024-03-24T10:39:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.477 7fdd81ffb700 1 -- 172.21.15.73:0/835576324 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+32132 (secure 0 0 0) 0x7fdd78000c30 con 0x7fdd840cc3d0 2024-03-24T10:39:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.478 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 >> v1:172.21.15.73:6816/43277 conn(0x7fdd6c0145b0 legacy=0x7fdd6c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.478 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 msgr2=0x7fdd840cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.478 7fdd8bb94700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdd7800c000 tx=0x7fdd7800ea10).stop 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 shutdown_connections 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd840d8f00 0x7fdd841bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdd840cc3d0 0x7fdd840cc820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 --2- 172.21.15.73:0/835576324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd840cce50 0x7fdd840d88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 >> 172.21.15.73:0/835576324 conn(0x7fdd840de910 msgr2=0x7fdd840d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 shutdown_connections 2024-03-24T10:39:29.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.479 7fdd8bb94700 1 -- 172.21.15.73:0/835576324 wait complete. 2024-03-24T10:39:29.489 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6816","nonce":43277}]},"active_addr":"172.21.15.73:6816/43277","active_change":"2024-03-24 10:39:05.106700","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2024-03-24T10:39:29.490 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-24T10:39:29.490 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-24T10:39:29.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:29.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 Processor -- start 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 -- start start 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 0x7f16d010ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00f91b0 con 0x7f16d00f1e40 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d010f060 con 0x7f16d00f2290 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.616 7f16d6902700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01ac600 con 0x7f16d00f58a0 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cfdec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 0x7f16d010ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46768/0 (socket says 172.21.15.73:46768) 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 -- 172.21.15.73:0/3475564628 learned_addr learned my addr 172.21.15.73:0/3475564628 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cfdec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 0x7f16d010ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56272/0 (socket says 172.21.15.73:56272) 2024-03-24T10:39:29.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cedea700 1 --1- 172.21.15.73:0/3475564628 >> v1:172.21.15.73:6789/0 conn(0x7f16d00f1e40 0x7f16d010e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36436/0 (socket says 172.21.15.73:36436) 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 -- 172.21.15.73:0/3475564628 >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 msgr2=0x7f16d010ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 --2- 172.21.15.73:0/3475564628 >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 0x7f16d010ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 -- 172.21.15.73:0/3475564628 >> v1:172.21.15.73:6789/0 conn(0x7f16d00f1e40 legacy=0x7f16d010e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 -- 172.21.15.73:0/3475564628 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d01ac7b0 con 0x7f16d00f58a0 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16cf5eb700 1 --2- 172.21.15.73:0/3475564628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f16c4002f70 tx=0x7f16c40099d0).ready entity=mon.1 client_cookie=85885b11e0069c12 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16ce5e9700 1 -- 172.21.15.73:0/3475564628 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16d01ac7b0 con 0x7f16d00f58a0 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16ce5e9700 1 -- 172.21.15.73:0/3475564628 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400f510 con 0x7f16d00f58a0 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16ce5e9700 1 -- 172.21.15.73:0/3475564628 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16c400f6f0 con 0x7f16d00f58a0 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16d6902700 1 -- 172.21.15.73:0/3475564628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 msgr2=0x7f16d00f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.617 7f16d6902700 1 --2- 172.21.15.73:0/3475564628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f16c4002f70 tx=0x7f16c40099d0).stop 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 -- 172.21.15.73:0/3475564628 shutdown_connections 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 --2- 172.21.15.73:0/3475564628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00f58a0 0x7f16d00f1810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 --2- 172.21.15.73:0/3475564628 >> v2:172.21.15.73:3300/0 conn(0x7f16d00f2290 0x7f16d010ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 -- 172.21.15.73:0/3475564628 >> 172.21.15.73:0/3475564628 conn(0x7f16d01139f0 msgr2=0x7f16d00f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 -- 172.21.15.73:0/3475564628 shutdown_connections 2024-03-24T10:39:29.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.618 7f16d6902700 1 -- 172.21.15.73:0/3475564628 wait complete. 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.640 7f16d6902700 1 Processor -- start 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.640 7f16d6902700 1 -- start start 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 0x7f16d01b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 0x7f16d01b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ce5a0 con 0x7f16d00cb9f0 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00bc4d0 con 0x7f16d00c5080 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01b4f40 con 0x7f16d00cbe40 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cf5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 0x7f16d01b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cf5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46782/0 (socket says 172.21.15.73:46782) 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cf5eb700 1 -- 172.21.15.73:0/462827758 learned_addr learned my addr 172.21.15.73:0/462827758 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cfdec700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 0x7f16d01b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 -- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 msgr2=0x7f16d01b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 0x7f16d01b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 -- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 msgr2=0x7f16d00cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 -- 172.21.15.73:0/462827758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d01b5170 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cfdec700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 0x7f16d01b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cf5eb700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16cedea700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 0x7f16d01b42e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f16d00d9870 tx=0x7f16c000c780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16d01b5170 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c00070d0 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.641 7f16d6902700 1 -- 172.21.15.73:0/462827758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d01bb9d0 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.642 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16c0005560 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.642 7f16d6902700 1 -- 172.21.15.73:0/462827758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d01bbdb0 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.642 7f16d6902700 1 -- 172.21.15.73:0/462827758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d00f0860 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.642 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f16c0005760 con 0x7f16d00cb9f0 2024-03-24T10:39:29.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.643 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f16c0014d10 con 0x7f16d00cb9f0 2024-03-24T10:39:29.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.646 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f16c000cd30 con 0x7f16d00cb9f0 2024-03-24T10:39:29.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.752 7f16d6902700 1 -- 172.21.15.73:0/462827758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16d01aea00 con 0x7f16d00cb9f0 2024-03-24T10:39:29.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.753 7f16ccde6700 1 -- 172.21.15.73:0/462827758 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f16c0000c30 con 0x7f16d00cb9f0 2024-03-24T10:39:29.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:29.753 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 >> v1:172.21.15.73:6816/43277 conn(0x7f16b00145b0 legacy=0x7f16b0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 msgr2=0x7f16d01b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 0x7f16d01b42e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f16d00d9870 tx=0x7f16c000c780).stop 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 shutdown_connections 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16d00cbe40 0x7f16d01b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16d00c5080 0x7f16d00cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 --2- 172.21.15.73:0/462827758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d00cb9f0 0x7f16d01b42e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 >> 172.21.15.73:0/462827758 conn(0x7f16d00dc640 msgr2=0x7f16d00bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 shutdown_connections 2024-03-24T10:39:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.754 7f16d6902700 1 -- 172.21.15.73:0/462827758 wait complete. 2024-03-24T10:39:29.765 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-24T10:39:29.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.890 7fe0bb4de700 1 Processor -- start 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.890 7fe0bb4de700 1 -- start start 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.890 7fe0bb4de700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0b40f5920 0x7fe0b40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.890 7fe0bb4de700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.890 7fe0bb4de700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0bb4de700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40f9230 con 0x7fe0b40f5920 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0bb4de700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b410ef10 con 0x7fe0b40f1ec0 2024-03-24T10:39:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0bb4de700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41aa660 con 0x7fe0b40f2310 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0b40f5920 0x7fe0b40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b8ada700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b8ada700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46388/0 (socket says 172.21.15.73:46388) 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0b40f5920 0x7fe0b40f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56286/0 (socket says 172.21.15.73:56286) 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:46798/0 (socket says 172.21.15.73:46798) 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b8ada700 1 -- 172.21.15.73:0/3742325561 learned_addr learned my addr 172.21.15.73:0/3742325561 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 -- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 msgr2=0x7fe0b410e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 -- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 msgr2=0x7fe0b410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 -- 172.21.15.73:0/3742325561 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b41aa810 con 0x7fe0b40f5920 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b37fe700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b8ada700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b3fff700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40f5920 0x7fe0b40f1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe0b40f4640 tx=0x7fe0a400ba20).ready entity=mon.0 client_cookie=f534bfd85f6f0bbd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b2ffd700 1 -- 172.21.15.73:0/3742325561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0b41aa810 con 0x7fe0b40f5920 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b2ffd700 1 -- 172.21.15.73:0/3742325561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400d570 con 0x7fe0b40f5920 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0b2ffd700 1 -- 172.21.15.73:0/3742325561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0a400d940 con 0x7fe0b40f5920 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0bb4de700 1 -- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40f5920 msgr2=0x7fe0b40f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.891 7fe0bb4de700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40f5920 0x7fe0b40f1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe0b40f4640 tx=0x7fe0a400ba20).stop 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 -- 172.21.15.73:0/3742325561 shutdown_connections 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40f2310 0x7fe0b410e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40f5920 0x7fe0b40f1890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 --2- 172.21.15.73:0/3742325561 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b40f1ec0 0x7fe0b410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 -- 172.21.15.73:0/3742325561 >> 172.21.15.73:0/3742325561 conn(0x7fe0b4113a70 msgr2=0x7fe0b40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 -- 172.21.15.73:0/3742325561 shutdown_connections 2024-03-24T10:39:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.892 7fe0bb4de700 1 -- 172.21.15.73:0/3742325561 wait complete. 2024-03-24T10:39:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 Processor -- start 2024-03-24T10:39:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 -- start start 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 0x7fe0b41b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b41b4e50 0x7fe0b41b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40da2c0 con 0x7fe0b40d10a0 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40da500 con 0x7fe0b41b4e50 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0bb4de700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40d9a30 con 0x7fe0b40d0620 2024-03-24T10:39:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b8ada700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b41b4e50 0x7fe0b41b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 0x7fe0b41b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46392/0 (socket says 172.21.15.73:46392) 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b3fff700 1 -- 172.21.15.73:0/452796092 learned_addr learned my addr 172.21.15.73:0/452796092 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.915 7fe0b3fff700 1 -- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b41b4e50 msgr2=0x7fe0b41b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b3fff700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b41b4e50 0x7fe0b41b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b3fff700 1 -- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 msgr2=0x7fe0b41b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b3fff700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 0x7fe0b41b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b3fff700 1 -- 172.21.15.73:0/452796092 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b41bbfd0 con 0x7fe0b40d0620 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b37fe700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 0x7fe0b41b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b3fff700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0b40bf100 tx=0x7fe0a40068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0b41bbfd0 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a4006ab0 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe0a4017040 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b41bc1d0 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41bc5b0 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe0a4011bb0 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.916 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe0a4018070 con 0x7fe0b40d0620 2024-03-24T10:39:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.917 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40f08e0 con 0x7fe0b40d0620 2024-03-24T10:39:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:29.920 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe0a40117b0 con 0x7fe0b40d0620 2024-03-24T10:39:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.024 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0b40a61a0 con 0x7fe0b40d0620 2024-03-24T10:39:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.025 7fe0b17fa700 1 -- 172.21.15.73:0/452796092 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7fe0a400d360 con 0x7fe0b40d0620 2024-03-24T10:39:30.025 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:30.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 >> v1:172.21.15.73:6816/43277 conn(0x7fe0980145b0 legacy=0x7fe098016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 msgr2=0x7fe0b40d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0b40bf100 tx=0x7fe0a40068c0).stop 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 shutdown_connections 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0b41b4e50 0x7fe0b41b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe0b40d0620 0x7fe0b40d0a70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 --2- 172.21.15.73:0/452796092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0b40d10a0 0x7fe0b41b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 >> 172.21.15.73:0/452796092 conn(0x7fe0b40deb80 msgr2=0x7fe0b40df6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 shutdown_connections 2024-03-24T10:39:30.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.026 7fe0bb4de700 1 -- 172.21.15.73:0/452796092 wait complete. 2024-03-24T10:39:30.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-24T10:39:30.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-24T10:39:30.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-24T10:39:30.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-24T10:39:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.175 7f54480e5700 1 Processor -- start 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.175 7f54480e5700 1 -- start start 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.175 7f54480e5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 0x7f544010c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54480e5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f544010c8e0 0x7f54400f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54480e5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f544010cd30 0x7f54400f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54480e5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400fa200 con 0x7f544010cd30 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54480e5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54400f9530 con 0x7f544010c8e0 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54480e5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54400f2460 con 0x7f54400f5890 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f5444ee0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 0x7f544010c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f5444ee0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 0x7f544010c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60490/0 (socket says 172.21.15.73:60490) 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f5444ee0700 1 -- 172.21.15.73:0/3597889479 learned_addr learned my addr 172.21.15.73:0/3597889479 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 --2- 172.21.15.73:0/3597889479 >> v2:172.21.15.73:3300/0 conn(0x7f544010cd30 0x7f54400f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f543ffff700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f544010c8e0 0x7f54400f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 -- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 msgr2=0x7f544010c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 0x7f544010c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 -- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f544010c8e0 msgr2=0x7f54400f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f544010c8e0 0x7f54400f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 -- 172.21.15.73:0/3597889479 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400f2690 con 0x7f544010cd30 2024-03-24T10:39:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f54456e1700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f544010cd30 0x7f54400f1e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f54380032f0 tx=0x7f543800f330).ready entity=mon.0 client_cookie=4197fc58bc1184f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7fd05d598700 1 Processor -- start 2024-03-24T10:39:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.176 7f543f7fe700 1 -- 172.21.15.73:0/3597889479 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54400f2690 con 0x7f544010cd30 2024-03-24T10:39:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f543f7fe700 1 -- 172.21.15.73:0/3597889479 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800fb70 con 0x7f544010cd30 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f543f7fe700 1 -- 172.21.15.73:0/3597889479 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5438013070 con 0x7f544010cd30 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 -- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f544010cd30 msgr2=0x7f54400f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f544010cd30 0x7f54400f1e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f54380032f0 tx=0x7f543800f330).stop 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 -- start start 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0580f5a00 0x7fd0581a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0581a14b0 0x7fd0580f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580f2300 con 0x7fd0580f1eb0 2024-03-24T10:39:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580fa330 con 0x7fd0580f5a00 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd05d598700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580f9660 con 0x7fd0581a14b0 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd0562b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0580f5a00 0x7fd0581a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd0562b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0580f5a00 0x7fd0581a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60310/0 (socket says 172.21.15.73:60310) 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd0562b1700 1 -- 172.21.15.73:0/1791762563 learned_addr learned my addr 172.21.15.73:0/1791762563 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 -- 172.21.15.73:0/3597889479 shutdown_connections 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f544010cd30 0x7f54400f1e30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54400f5890 0x7f544010c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 --2- 172.21.15.73:0/3597889479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f544010c8e0 0x7f54400f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7f54480e5700 1 -- 172.21.15.73:0/3597889479 >> 172.21.15.73:0/3597889479 conn(0x7f54401139e0 msgr2=0x7f54400f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.177 7fd055ab0700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0581a14b0 0x7fd0580f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0562b1700 1 -- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0581a14b0 msgr2=0x7fd0580f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0562b1700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0581a14b0 0x7fd0580f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0562b1700 1 -- 172.21.15.73:0/1791762563 >> v1:172.21.15.73:6789/0 conn(0x7fd0580f1eb0 legacy=0x7fd0581ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0562b1700 1 -- 172.21.15.73:0/1791762563 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580f2520 con 0x7fd0580f5a00 2024-03-24T10:39:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7f54480e5700 1 -- 172.21.15.73:0/3597889479 shutdown_connections 2024-03-24T10:39:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7f54480e5700 1 -- 172.21.15.73:0/3597889479 wait complete. 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0562b1700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0580f5a00 0x7fd0581a0e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd0580f9810 tx=0x7fd04c009a80).ready entity=mon.0 client_cookie=7a6459cf3af8ea45 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0552af700 1 -- 172.21.15.73:0/1791762563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0580f2520 con 0x7fd0580f5a00 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0552af700 1 -- 172.21.15.73:0/1791762563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00f510 con 0x7fd0580f5a00 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd0552af700 1 -- 172.21.15.73:0/1791762563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd04c00f740 con 0x7fd0580f5a00 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd05d598700 1 -- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0580f5a00 msgr2=0x7fd0581a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.178 7fd05d598700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0580f5a00 0x7fd0581a0e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd0580f9810 tx=0x7fd04c009a80).stop 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 -- 172.21.15.73:0/1791762563 shutdown_connections 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0580f5a00 0x7fd0581a0e80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 --2- 172.21.15.73:0/1791762563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0581a14b0 0x7fd0580f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 -- 172.21.15.73:0/1791762563 >> 172.21.15.73:0/1791762563 conn(0x7fd058113a60 msgr2=0x7fd0580f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 -- 172.21.15.73:0/1791762563 shutdown_connections 2024-03-24T10:39:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.179 7fd05d598700 1 -- 172.21.15.73:0/1791762563 wait complete. 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.181 7fae5adca700 1 Processor -- start 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.181 7fae5adca700 1 -- start start 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae5adca700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 0x7fae541a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae5adca700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae540f2080 0x7fae541af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae5adca700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540f24d0 con 0x7fae541a14b0 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae5adca700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540fa330 con 0x7fae540f2080 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae5adca700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae540f9660 con 0x7fae540f5a00 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae52ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fae541a14b0 0x7fae540f1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49324/0 (socket says 172.21.15.73:49324) 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae52ffd700 1 -- 172.21.15.73:0/3350212487 learned_addr learned my addr 172.21.15.73:0/3350212487 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae53fff700 1 --2- 172.21.15.73:0/3350212487 >> v2:172.21.15.73:3300/0 conn(0x7fae540f2080 0x7fae541af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae537fe700 1 --2- 172.21.15.73:0/3350212487 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 0x7fae541a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae527fc700 1 -- 172.21.15.73:0/3350212487 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151036886 0 0) 0x7fae48001110 con 0x7fae541a14b0 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae527fc700 1 -- 172.21.15.73:0/3350212487 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae40003270 con 0x7fae541a14b0 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.182 7fae537fe700 1 -- 172.21.15.73:0/3350212487 >> v2:172.21.15.73:3300/0 conn(0x7fae540f2080 msgr2=0x7fae541af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae537fe700 1 --2- 172.21.15.73:0/3350212487 >> v2:172.21.15.73:3300/0 conn(0x7fae540f2080 0x7fae541af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae537fe700 1 -- 172.21.15.73:0/3350212487 >> v1:172.21.15.73:6789/0 conn(0x7fae541a14b0 legacy=0x7fae540f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 Processor -- start 2024-03-24T10:39:30.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae537fe700 1 -- 172.21.15.73:0/3350212487 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae541b0e50 con 0x7fae540f5a00 2024-03-24T10:39:30.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae537fe700 1 --2- 172.21.15.73:0/3350212487 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 0x7fae541a0e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fae44002f70 tx=0x7fae4400b970).ready entity=mon.2 client_cookie=b99f193011e3a377 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 -- start start 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bf40f5a00 0x7f9bf410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf410b730 0x7f9bf419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf410bb80 0x7f9bf41a0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40fa580 con 0x7f9bf40f5a00 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf41a0890 con 0x7f9bf410b730 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf9c3b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf41a0ac0 con 0x7f9bf410bb80 2024-03-24T10:39:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bf40f5a00 0x7f9bf410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bf40f5a00 0x7f9bf410b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60316/0 (socket says 172.21.15.73:60316) 2024-03-24T10:39:30.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 -- 172.21.15.73:0/2996851633 learned_addr learned my addr 172.21.15.73:0/2996851633 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae527fc700 1 -- 172.21.15.73:0/3350212487 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae541b0e50 con 0x7fae540f5a00 2024-03-24T10:39:30.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf305e700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf410bb80 0x7f9bf41a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae527fc700 1 -- 172.21.15.73:0/3350212487 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400d610 con 0x7fae540f5a00 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae527fc700 1 -- 172.21.15.73:0/3350212487 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae4400d9e0 con 0x7fae540f5a00 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae5adca700 1 -- 172.21.15.73:0/3350212487 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 msgr2=0x7fae541a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7fae5adca700 1 --2- 172.21.15.73:0/3350212487 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 0x7fae541a0e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fae44002f70 tx=0x7fae4400b970).stop 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 -- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf410bb80 msgr2=0x7f9bf41a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf410bb80 0x7f9bf41a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 -- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf410b730 msgr2=0x7f9bf419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf410b730 0x7f9bf419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.183 7f9bf285d700 1 -- 172.21.15.73:0/2996851633 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf41a73a0 con 0x7f9bf40f5a00 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf285d700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40f5a00 0x7f9bf410b100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9be40032f0 tx=0x7f9be4009de0).ready entity=mon.0 client_cookie=46ed74438323755d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf205c700 1 -- 172.21.15.73:0/2996851633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9bf41a73a0 con 0x7f9bf40f5a00 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf205c700 1 -- 172.21.15.73:0/2996851633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4012980 con 0x7f9bf40f5a00 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf205c700 1 -- 172.21.15.73:0/2996851633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9be4012d50 con 0x7f9bf40f5a00 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf9c3b700 1 -- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40f5a00 msgr2=0x7f9bf410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.184 7f9bf9c3b700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40f5a00 0x7f9bf410b100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9be40032f0 tx=0x7f9be4009de0).stop 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 -- 172.21.15.73:0/3350212487 shutdown_connections 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 --2- 172.21.15.73:0/3350212487 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540f5a00 0x7fae541a0e80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 --2- 172.21.15.73:0/3350212487 >> v2:172.21.15.73:3300/0 conn(0x7fae540f2080 0x7fae541af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 -- 172.21.15.73:0/3350212487 >> 172.21.15.73:0/3350212487 conn(0x7fae54113a60 msgr2=0x7fae540f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 -- 172.21.15.73:0/3350212487 shutdown_connections 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7fae5adca700 1 -- 172.21.15.73:0/3350212487 wait complete. 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 -- 172.21.15.73:0/2996851633 shutdown_connections 2024-03-24T10:39:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf410bb80 0x7f9bf41a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40f5a00 0x7f9bf410b100 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 --2- 172.21.15.73:0/2996851633 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf410b730 0x7f9bf419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 -- 172.21.15.73:0/2996851633 >> 172.21.15.73:0/2996851633 conn(0x7f9bf4113a60 msgr2=0x7f9bf40f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 -- 172.21.15.73:0/2996851633 shutdown_connections 2024-03-24T10:39:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.185 7f9bf9c3b700 1 -- 172.21.15.73:0/2996851633 wait complete. 2024-03-24T10:39:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.202 7f54480e5700 1 Processor -- start 2024-03-24T10:39:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.202 7f54480e5700 1 -- start start 2024-03-24T10:39:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 Processor -- start 2024-03-24T10:39:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 -- start start 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 0x7fd0581b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd0581b21a0 0x7fd0580c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0581b25f0 0x7fd0580c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580d0090 con 0x7fd0581b25f0 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580cfe10 con 0x7fd0580cf9c0 2024-03-24T10:39:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54401a92e0 0x7f54401a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd05d598700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580d77f0 con 0x7fd0581b21a0 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54401a9d60 0x7f54401afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 0x7f54401b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400dbe90 con 0x7f54401a9d60 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54400da3c0 con 0x7f54401b0390 2024-03-24T10:39:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54480e5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54400c1eb0 con 0x7f54401a92e0 2024-03-24T10:39:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54456e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 0x7f54401b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54456e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 0x7f54401b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45458/0 (socket says 172.21.15.73:45458) 2024-03-24T10:39:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7f54456e1700 1 -- 172.21.15.73:0/1530464319 learned_addr learned my addr 172.21.15.73:0/1530464319 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd0562b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 0x7fd0581b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd056ab2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0581b25f0 0x7fd0580c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd0562b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 0x7fd0581b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45468/0 (socket says 172.21.15.73:45468) 2024-03-24T10:39:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.203 7fd0562b1700 1 -- 172.21.15.73:0/2435544984 learned_addr learned my addr 172.21.15.73:0/2435544984 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd055ab0700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd0581b21a0 0x7fd0580c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 -- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54401a92e0 msgr2=0x7f54401a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 --2- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f54401a92e0 0x7f54401a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 -- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54401a9d60 msgr2=0x7f54401afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 --2- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54401a9d60 0x7f54401afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 -- 172.21.15.73:0/1530464319 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54401b7450 con 0x7f54401b0390 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54456e1700 1 --2- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 0x7f54401b07e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f54380032f0 tx=0x7f5438006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 -- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd0581b21a0 msgr2=0x7fd0580c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd0581b21a0 0x7fd0580c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 -- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 msgr2=0x7fd0581b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 0x7fd0581b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 -- 172.21.15.73:0/2435544984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580c6fd0 con 0x7fd0581b25f0 2024-03-24T10:39:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54401b7450 con 0x7f54401b0390 2024-03-24T10:39:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438017a80 con 0x7f54401b0390 2024-03-24T10:39:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd0562b1700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0580cf9c0 0x7fd0581b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f543800b450 con 0x7f54401b0390 2024-03-24T10:39:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54480e5700 1 -- 172.21.15.73:0/1530464319 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54401b7650 con 0x7f54401b0390 2024-03-24T10:39:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd056ab2700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0581b25f0 0x7fd0580c69a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd0580c5710 tx=0x7fd0480097b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0580c6fd0 con 0x7fd0581b25f0 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048011400 con 0x7fd0581b25f0 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0480115e0 con 0x7fd0581b25f0 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.205 7fd05d598700 1 -- 172.21.15.73:0/2435544984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0581bfc60 con 0x7fd0581b25f0 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.204 7f54480e5700 1 -- 172.21.15.73:0/1530464319 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54401b7a30 con 0x7f54401b0390 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.205 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f543802a060 con 0x7f54401b0390 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.205 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f543801bde0 con 0x7f54401b0390 2024-03-24T10:39:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.205 7f54480e5700 1 -- 172.21.15.73:0/1530464319 --> v1:172.21.15.73:6804/43870 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5440087740 con 0x7f54400c7cc0 2024-03-24T10:39:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.205 7fd05d598700 1 -- 172.21.15.73:0/2435544984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0581c0040 con 0x7fd0581b25f0 2024-03-24T10:39:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.206 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd048018020 con 0x7fd0581b25f0 2024-03-24T10:39:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.206 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd048019a00 con 0x7fd0581b25f0 2024-03-24T10:39:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.207 7fd05d598700 1 -- 172.21.15.73:0/2435544984 --> v1:172.21.15.73:6800/43869 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd058087740 con 0x7fd0580a7740 2024-03-24T10:39:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.208 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== osd.2 v1:172.21.15.73:6804/43870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f542c0094a0 con 0x7f54400c7cc0 2024-03-24T10:39:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 Processor -- start 2024-03-24T10:39:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7f9bf9c3b700 1 Processor -- start 2024-03-24T10:39:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 -- start start 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540c4000 0x7fae541b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae541b6080 0x7fae541b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae541b64d0 0x7fae541b9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae540d48c0 con 0x7fae541b64d0 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae541b97b0 con 0x7fae541b6080 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.209 7fae5adca700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae541b99e0 con 0x7fae540c4000 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae52ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae541b6080 0x7fae541b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae52ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae541b6080 0x7fae541b8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45474/0 (socket says 172.21.15.73:45474) 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae52ffd700 1 -- 172.21.15.73:0/751189843 learned_addr learned my addr 172.21.15.73:0/751189843 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 --2- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae541b64d0 0x7fae541b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 -- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540c4000 msgr2=0x7fae541b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 --2- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae540c4000 0x7fae541b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 -- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae541b6080 msgr2=0x7fae541b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 --2- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae541b6080 0x7fae541b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 -- 172.21.15.73:0/751189843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54106d50 con 0x7fae541b64d0 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae53fff700 1 --2- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae541b64d0 0x7fae541b9180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fae4c00c000 tx=0x7fae4c00edd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae54106d50 con 0x7fae541b64d0 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae5adca700 1 -- 172.21.15.73:0/751189843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae54106fb0 con 0x7fae541b64d0 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae5adca700 1 -- 172.21.15.73:0/751189843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae54107510 con 0x7fae541b64d0 2024-03-24T10:39:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== osd.3 v1:172.21.15.73:6800/43869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fd05000c530 con 0x7fd0580a7740 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00c880 con 0x7fae541b64d0 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae4c00f040 con 0x7fae541b64d0 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fae4c022060 con 0x7fae541b64d0 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7fae5adca700 1 -- 172.21.15.73:0/751189843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae300036d0 con 0x7fae541b64d0 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fae4c010040 con 0x7fae541b64d0 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7fae50ff9700 1 -- 172.21.15.73:0/751189843 --> v1:172.21.15.73:6808/43871 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae3401ed70 con 0x7fae3401af60 2024-03-24T10:39:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae4c0216a0 con 0x7fae541b64d0 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 -- start start 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40d5670 0x7f9bf40d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf40d60f0 0x7f9bf41afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 0x7f9bf41b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40dd560 con 0x7f9bf40d5670 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40dc9a0 con 0x7f9bf41b02d0 2024-03-24T10:39:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.210 7f9bf9c3b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40dc350 con 0x7f9bf40d60f0 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 0x7f9bf41b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 0x7f9bf41b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45484/0 (socket says 172.21.15.73:45484) 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 -- 172.21.15.73:0/2507451841 learned_addr learned my addr 172.21.15.73:0/2507451841 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bea05c700 1 --2- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf40d60f0 0x7f9bf41afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 -- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf40d60f0 msgr2=0x7f9bf41afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 --2- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9bf40d60f0 0x7f9bf41afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 -- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40d5670 msgr2=0x7f9bf40d5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 --2- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf40d5670 0x7f9bf40d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.211 7f9bf305e700 1 -- 172.21.15.73:0/2507451841 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40ccdf0 con 0x7f9bf41b02d0 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf305e700 1 --2- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 0x7f9bf41b0720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9bf40ce670 tx=0x7f9bec00da30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9bf40ccdf0 con 0x7f9bf41b02d0 2024-03-24T10:39:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== osd.0 v1:172.21.15.73:6808/43871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fae3401ed70 con 0x7fae3401af60 2024-03-24T10:39:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec011780 con 0x7f9bf41b02d0 2024-03-24T10:39:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf41b7410 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9bec00f040 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.212 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf41b77f0 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.213 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bf40d6540 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.213 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9bec011b50 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.213 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9bec010070 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.213 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 --> v1:172.21.15.73:6812/43872 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bd801ed00 con 0x7f9bd801aef0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.213 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bec008d50 con 0x7f9bf41b02d0 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.214 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== osd.1 v1:172.21.15.73:6812/43872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f9bd801ed00 con 0x7f9bd801aef0 2024-03-24T10:39:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.216 7f54480e5700 1 -- 172.21.15.73:0/1530464319 --> v1:172.21.15.73:6804/43870 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54401aa1b0 con 0x7f54400c7cc0 2024-03-24T10:39:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.219 7f543dffb700 1 -- 172.21.15.73:0/1530464319 <== osd.2 v1:172.21.15.73:6804/43870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2652970471) 0x7f542c009680 con 0x7f54400c7cc0 2024-03-24T10:39:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.219 7fd05d598700 1 -- 172.21.15.73:0/2435544984 --> v1:172.21.15.73:6800/43869 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0580f08d0 con 0x7fd0580a7740 2024-03-24T10:39:30.222 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-03-24T10:39:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.219 7fd0477fe700 1 -- 172.21.15.73:0/2435544984 <== osd.3 v1:172.21.15.73:6800/43869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7fd0580f08d0 con 0x7fd0580a7740 2024-03-24T10:39:30.223 INFO:teuthology.orchestra.run.smithi073.stdout:38654705670 2024-03-24T10:39:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7f54480e5700 1 -- 172.21.15.73:0/1530464319 >> v1:172.21.15.73:6804/43870 conn(0x7f54400c7cc0 legacy=0x7f54400a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 -- 172.21.15.73:0/2435544984 >> v1:172.21.15.73:6800/43869 conn(0x7fd0580a7740 legacy=0x7fd0580a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7f54480e5700 1 -- 172.21.15.73:0/1530464319 >> v1:172.21.15.73:6816/43277 conn(0x7f5428014600 legacy=0x7f5428016b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7f54480e5700 1 -- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 msgr2=0x7f54401b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7f54480e5700 1 --2- 172.21.15.73:0/1530464319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54401b0390 0x7f54401b07e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f54380032f0 tx=0x7f5438006c40).stop 2024-03-24T10:39:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7f54456e1700 1 -- 172.21.15.73:0/1530464319 reap_dead start 2024-03-24T10:39:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 -- 172.21.15.73:0/2435544984 >> v1:172.21.15.73:6816/43277 conn(0x7fd034014600 legacy=0x7fd034016b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 -- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0581b25f0 msgr2=0x7fd0580c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 --2- 172.21.15.73:0/2435544984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0581b25f0 0x7fd0580c69a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd0580c5710 tx=0x7fd0480097b0).stop 2024-03-24T10:39:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd056ab2700 1 -- 172.21.15.73:0/2435544984 reap_dead start 2024-03-24T10:39:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 -- 172.21.15.73:0/2435544984 shutdown_connections 2024-03-24T10:39:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.222 7fd05d598700 1 -- 172.21.15.73:0/2435544984 >> 172.21.15.73:0/2435544984 conn(0x7fd0580c9250 msgr2=0x7fd0580c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7f54480e5700 1 -- 172.21.15.73:0/1530464319 shutdown_connections 2024-03-24T10:39:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7f54480e5700 1 -- 172.21.15.73:0/1530464319 >> 172.21.15.73:0/1530464319 conn(0x7f54400e1130 msgr2=0x7f54400c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7fd05d598700 1 -- 172.21.15.73:0/2435544984 shutdown_connections 2024-03-24T10:39:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7fd05d598700 1 -- 172.21.15.73:0/2435544984 wait complete. 2024-03-24T10:39:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7f54480e5700 1 -- 172.21.15.73:0/1530464319 shutdown_connections 2024-03-24T10:39:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.223 7f54480e5700 1 -- 172.21.15.73:0/1530464319 wait complete. 2024-03-24T10:39:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae5adca700 1 -- 172.21.15.73:0/751189843 --> v1:172.21.15.73:6808/43871 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae300028e0 con 0x7fae3401af60 2024-03-24T10:39:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae50ff9700 1 -- 172.21.15.73:0/751189843 <== osd.0 v1:172.21.15.73:6808/43871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7fae300028e0 con 0x7fae3401af60 2024-03-24T10:39:30.228 INFO:teuthology.orchestra.run.smithi073.stdout:38654705670 2024-03-24T10:39:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae5adca700 1 -- 172.21.15.73:0/751189843 >> v1:172.21.15.73:6808/43871 conn(0x7fae3401af60 legacy=0x7fae3401d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae5adca700 1 -- 172.21.15.73:0/751189843 >> v1:172.21.15.73:6816/43277 conn(0x7fae340145b0 legacy=0x7fae34016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae5adca700 1 -- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae541b64d0 msgr2=0x7fae541b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae5adca700 1 --2- 172.21.15.73:0/751189843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae541b64d0 0x7fae541b9180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fae4c00c000 tx=0x7fae4c00edd0).stop 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.224 7fae53fff700 1 -- 172.21.15.73:0/751189843 reap_dead start 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.225 7fae5adca700 1 -- 172.21.15.73:0/751189843 shutdown_connections 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.225 7fae5adca700 1 -- 172.21.15.73:0/751189843 >> 172.21.15.73:0/751189843 conn(0x7fae541a8d70 msgr2=0x7fae540d7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.225 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 --> v1:172.21.15.73:6812/43872 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bf4087740 con 0x7f9bd801aef0 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.226 7fae5adca700 1 -- 172.21.15.73:0/751189843 shutdown_connections 2024-03-24T10:39:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.226 7fae5adca700 1 -- 172.21.15.73:0/751189843 wait complete. 2024-03-24T10:39:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.226 7f9bf0859700 1 -- 172.21.15.73:0/2507451841 <== osd.1 v1:172.21.15.73:6812/43872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2652970471) 0x7f9bdc0094a0 con 0x7f9bd801aef0 2024-03-24T10:39:30.230 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.226 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 >> v1:172.21.15.73:6812/43872 conn(0x7f9bd801aef0 legacy=0x7f9bd801d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 >> v1:172.21.15.73:6816/43277 conn(0x7f9bd8014540 legacy=0x7f9bd8016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 msgr2=0x7f9bf41b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 --2- 172.21.15.73:0/2507451841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9bf41b02d0 0x7f9bf41b0720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9bf40ce670 tx=0x7f9bec00da30).stop 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf305e700 1 -- 172.21.15.73:0/2507451841 reap_dead start 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 shutdown_connections 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 >> 172.21.15.73:0/2507451841 conn(0x7f9bf40c4d30 msgr2=0x7f9bf40e0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 shutdown_connections 2024-03-24T10:39:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.228 7f9bf9c3b700 1 -- 172.21.15.73:0/2507451841 wait complete. 2024-03-24T10:39:30.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-24T10:39:30.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-24T10:39:30.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-24T10:39:30.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-24T10:39:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.373 7f4e24b38700 1 Processor -- start 2024-03-24T10:39:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 -- start start 2024-03-24T10:39:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 0x7f4e2010c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e20104d90 con 0x7f4e2010cce0 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2010d130 con 0x7f4e200fb090 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.374 7f4e24b38700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200f2200 con 0x7f4e201a1540 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1d850700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 0x7f4e2010c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1d850700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 0x7f4e2010c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60368/0 (socket says 172.21.15.73:60368) 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45492/0 (socket says 172.21.15.73:45492) 2024-03-24T10:39:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1d850700 1 -- 172.21.15.73:0/1757361931 learned_addr learned my addr 172.21.15.73:0/1757361931 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 -- 172.21.15.73:0/1757361931 >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 msgr2=0x7f4e2010c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 --2- 172.21.15.73:0/1757361931 >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 0x7f4e2010c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 -- 172.21.15.73:0/1757361931 >> v1:172.21.15.73:6789/0 conn(0x7f4e2010cce0 legacy=0x7f4e201a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 -- 172.21.15.73:0/1757361931 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e201aa220 con 0x7f4e201a1540 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1e051700 1 --2- 172.21.15.73:0/1757361931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4e14001380 tx=0x7f4e14001080).ready entity=mon.1 client_cookie=75db0eb8a9dcad9d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1c84e700 1 -- 172.21.15.73:0/1757361931 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e201aa220 con 0x7f4e201a1540 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1c84e700 1 -- 172.21.15.73:0/1757361931 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800b740 con 0x7f4e201a1540 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e1c84e700 1 -- 172.21.15.73:0/1757361931 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e1800b920 con 0x7f4e201a1540 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e24b38700 1 -- 172.21.15.73:0/1757361931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 msgr2=0x7f4e201a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.375 7f4e24b38700 1 --2- 172.21.15.73:0/1757361931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4e14001380 tx=0x7f4e14001080).stop 2024-03-24T10:39:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 Processor -- start 2024-03-24T10:39:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 -- start start 2024-03-24T10:39:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7f4e24b38700 1 -- 172.21.15.73:0/1757361931 shutdown_connections 2024-03-24T10:39:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7f4e24b38700 1 --2- 172.21.15.73:0/1757361931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a1540 0x7f4e201a1990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7f4e24b38700 1 --2- 172.21.15.73:0/1757361931 >> v2:172.21.15.73:3300/0 conn(0x7f4e200fb090 0x7f4e2010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7f4e24b38700 1 -- 172.21.15.73:0/1757361931 >> 172.21.15.73:0/1757361931 conn(0x7f4e201148b0 msgr2=0x7f4e20114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7f4e24b38700 1 -- 172.21.15.73:0/1757361931 shutdown_connections 2024-03-24T10:39:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7f4e24b38700 1 -- 172.21.15.73:0/1757361931 wait complete. 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 0x7fa3c81a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c81a09e0 con 0x7fa3c810b6b0 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80fa500 con 0x7fa3c80f5980 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.376 7fa3ce746700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81a0c00 con 0x7fa3c810bb00 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45494/0 (socket says 172.21.15.73:45494) 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 -- 172.21.15.73:0/2385588038 learned_addr learned my addr 172.21.15.73:0/2385588038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c7bb1700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 0x7fa3c81a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 -- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 msgr2=0x7fa3c81a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 0x7fa3c81a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 -- 172.21.15.73:0/2385588038 >> v1:172.21.15.73:6789/0 conn(0x7fa3c810b6b0 legacy=0x7fa3c819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 -- 172.21.15.73:0/2385588038 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c81a9340 con 0x7fa3c80f5980 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c7bb1700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 0x7fa3c81a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:39:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.377 7fa3c73b0700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa3c8103980 tx=0x7fa3c0009e40).ready entity=mon.1 client_cookie=855ccd1c89cb3414 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3c63ae700 1 -- 172.21.15.73:0/2385588038 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3c81a9340 con 0x7fa3c80f5980 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3c63ae700 1 -- 172.21.15.73:0/2385588038 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c000b870 con 0x7fa3c80f5980 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3c63ae700 1 -- 172.21.15.73:0/2385588038 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3c000ba50 con 0x7fa3c80f5980 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 -- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 msgr2=0x7fa3c810b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa3c8103980 tx=0x7fa3c0009e40).stop 2024-03-24T10:39:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 -- 172.21.15.73:0/2385588038 shutdown_connections 2024-03-24T10:39:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c810bb00 0x7fa3c81a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 --2- 172.21.15.73:0/2385588038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c80f5980 0x7fa3c810b080 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 -- 172.21.15.73:0/2385588038 >> 172.21.15.73:0/2385588038 conn(0x7fa3c81139e0 msgr2=0x7fa3c80f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 -- 172.21.15.73:0/2385588038 shutdown_connections 2024-03-24T10:39:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.382 7fa3ce746700 1 -- 172.21.15.73:0/2385588038 wait complete. 2024-03-24T10:39:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.407 7fa3ce746700 1 Processor -- start 2024-03-24T10:39:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 -- start start 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 0x7fa3c81b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c81b2a30 0x7fa3c81b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80c6370 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81b34b0 con 0x7fa3c81ac230 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3ce746700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80dc4e0 con 0x7fa3c81b2a30 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60370/0 (socket says 172.21.15.73:60370) 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 -- 172.21.15.73:0/3888644505 learned_addr learned my addr 172.21.15.73:0/3888644505 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c6baf700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 0x7fa3c81b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 -- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c81b2a30 msgr2=0x7fa3c81b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c81b2a30 0x7fa3c81b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 -- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 msgr2=0x7fa3c81b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 0x7fa3c81b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c73b0700 1 -- 172.21.15.73:0/3888644505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80d14d0 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.408 7fa3c6baf700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 0x7fa3c81b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3c73b0700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa3c81a6050 tx=0x7fa3c0006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3c80d14d0 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0011c30 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c81b9af0 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3c001c440 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c81b9ed0 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.409 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa3c0019030 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.410 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa3c0018040 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.410 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c80f0850 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 Processor -- start 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 -- start start 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 0x7f4e201a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 0x7f4e200c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e200c7920 0x7f4e201b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c5b20 con 0x7f4e200c7920 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c83d0 con 0x7f4e201a9e00 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e24b38700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c4700 con 0x7f4e201a9380 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e1d850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 0x7f4e201a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e1d850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 0x7f4e201a97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60550/0 (socket says 172.21.15.73:60550) 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e1d04f700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 0x7f4e200c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.412 7f4e1d850700 1 -- 172.21.15.73:0/1615897526 learned_addr learned my addr 172.21.15.73:0/1615897526 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1e051700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e200c7920 0x7f4e201b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 -- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 msgr2=0x7f4e201a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 0x7f4e201a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 -- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e200c7920 msgr2=0x7f4e201b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e200c7920 0x7f4e201b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 -- 172.21.15.73:0/1615897526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200d52b0 con 0x7f4e201a9e00 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e1d04f700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 0x7f4e200c72f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4e200c4ef0 tx=0x7f4e1400c9c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e200d52b0 con 0x7f4e201a9e00 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1400e4a0 con 0x7f4e201a9e00 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e1400e870 con 0x7f4e201a9e00 2024-03-24T10:39:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e200c7d70 con 0x7f4e201a9e00 2024-03-24T10:39:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.413 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e201b7b80 con 0x7f4e201a9e00 2024-03-24T10:39:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.414 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4e1400ea70 con 0x7f4e201a9e00 2024-03-24T10:39:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.414 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa3c0011a20 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.414 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4e14010300 con 0x7f4e201a9e00 2024-03-24T10:39:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.415 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e200f0850 con 0x7f4e201a9e00 2024-03-24T10:39:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.418 7fe7f6107700 1 Processor -- start 2024-03-24T10:39:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.418 7fe7f6107700 1 -- start start 2024-03-24T10:39:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.418 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4e1400e290 con 0x7f4e201a9e00 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.418 7fe7f6107700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7f6107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 0x7fe7f01a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7f6107700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f00f9d90 con 0x7fe7f01a1840 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7f6107700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f0102df0 con 0x7fe7f01a0dc0 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7f6107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0103d00 con 0x7fe7f01038b0 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eedc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eedc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60388/0 (socket says 172.21.15.73:60388) 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eedc6700 1 -- 172.21.15.73:0/428705319 learned_addr learned my addr 172.21.15.73:0/428705319 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ee5c5700 1 --1- 172.21.15.73:0/428705319 >> v1:172.21.15.73:6789/0 conn(0x7fe7f01a1840 0x7fe7f01030b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49366/0 (socket says 172.21.15.73:49366) 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 --2- 172.21.15.73:0/428705319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 0x7fe7f01a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eddc4700 1 -- 172.21.15.73:0/428705319 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204181978 0 0) 0x7fe7e4001110 con 0x7fe7f01a1840 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 -- 172.21.15.73:0/428705319 >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 msgr2=0x7fe7f01a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 --2- 172.21.15.73:0/428705319 >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 -- 172.21.15.73:0/428705319 >> v1:172.21.15.73:6789/0 conn(0x7fe7f01a1840 legacy=0x7fe7f01030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 -- 172.21.15.73:0/428705319 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0103f30 con 0x7fe7f01038b0 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eedc6700 1 --2- 172.21.15.73:0/428705319 >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7ef5c7700 1 --2- 172.21.15.73:0/428705319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 0x7fe7f01a93d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe7e80032f0 tx=0x7fe7e8009c90).ready entity=mon.1 client_cookie=fea9455cbb707b3d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.419 7fe7eddc4700 1 -- 172.21.15.73:0/428705319 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7f0103f30 con 0x7fe7f01038b0 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.420 7fe7eddc4700 1 -- 172.21.15.73:0/428705319 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800b820 con 0x7fe7f01038b0 2024-03-24T10:39:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.420 7fe7eddc4700 1 -- 172.21.15.73:0/428705319 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7e800ba00 con 0x7fe7f01038b0 2024-03-24T10:39:30.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.420 7fe7f6107700 1 -- 172.21.15.73:0/428705319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 msgr2=0x7fe7f01a93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.420 7fe7f6107700 1 --2- 172.21.15.73:0/428705319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 0x7fe7f01a93d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe7e80032f0 tx=0x7fe7e8009c90).stop 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 -- 172.21.15.73:0/428705319 shutdown_connections 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 --2- 172.21.15.73:0/428705319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f01038b0 0x7fe7f01a93d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 --2- 172.21.15.73:0/428705319 >> v2:172.21.15.73:3300/0 conn(0x7fe7f01a0dc0 0x7fe7f01a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 -- 172.21.15.73:0/428705319 >> 172.21.15.73:0/428705319 conn(0x7fe7f0113570 msgr2=0x7fe7f00f4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 -- 172.21.15.73:0/428705319 shutdown_connections 2024-03-24T10:39:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.421 7fe7f6107700 1 -- 172.21.15.73:0/428705319 wait complete. 2024-03-24T10:39:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 Processor -- start 2024-03-24T10:39:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 -- start start 2024-03-24T10:39:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 0x7fc9101a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9101a09e0 con 0x7fc91010b6b0 2024-03-24T10:39:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100fa500 con 0x7fc91010bb00 2024-03-24T10:39:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.430 7fc91698a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101a0c00 con 0x7fc9100f5980 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45528/0 (socket says 172.21.15.73:45528) 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 -- 172.21.15.73:0/3313924479 learned_addr learned my addr 172.21.15.73:0/3313924479 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90fdec700 1 --2- 172.21.15.73:0/3313924479 >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 0x7fc9101a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 -- 172.21.15.73:0/3313924479 >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 msgr2=0x7fc9101a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 --2- 172.21.15.73:0/3313924479 >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 0x7fc9101a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 -- 172.21.15.73:0/3313924479 >> v1:172.21.15.73:6789/0 conn(0x7fc91010b6b0 legacy=0x7fc91019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 -- 172.21.15.73:0/3313924479 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9101a9340 con 0x7fc9100f5980 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90fdec700 1 --2- 172.21.15.73:0/3313924479 >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 0x7fc9101a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90f5eb700 1 --2- 172.21.15.73:0/3313924479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc900002f70 tx=0x7fc9000099d0).ready entity=mon.1 client_cookie=d05099c8760173a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90e5e9700 1 -- 172.21.15.73:0/3313924479 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9101a9340 con 0x7fc9100f5980 2024-03-24T10:39:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90e5e9700 1 -- 172.21.15.73:0/3313924479 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000f510 con 0x7fc9100f5980 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc90e5e9700 1 -- 172.21.15.73:0/3313924479 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc90000f6f0 con 0x7fc9100f5980 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc91698a700 1 -- 172.21.15.73:0/3313924479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 msgr2=0x7fc91010b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.431 7fc91698a700 1 --2- 172.21.15.73:0/3313924479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc900002f70 tx=0x7fc9000099d0).stop 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 -- 172.21.15.73:0/3313924479 shutdown_connections 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 --2- 172.21.15.73:0/3313924479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9100f5980 0x7fc91010b080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 --2- 172.21.15.73:0/3313924479 >> v2:172.21.15.73:3300/0 conn(0x7fc91010bb00 0x7fc9101a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 -- 172.21.15.73:0/3313924479 >> 172.21.15.73:0/3313924479 conn(0x7fc9101139e0 msgr2=0x7fc9100f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 -- 172.21.15.73:0/3313924479 shutdown_connections 2024-03-24T10:39:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.432 7fc91698a700 1 -- 172.21.15.73:0/3313924479 wait complete. 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 Processor -- start 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 -- start start 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7f00e0020 0x7fe7f01af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00e0470 0x7fe7f01af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00d4770 con 0x7fe7f00e0470 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00d43e0 con 0x7fe7f00df3a0 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.445 7fe7f6107700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00d4a30 con 0x7fe7f00e0020 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45540/0 (socket says 172.21.15.73:45540) 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 -- 172.21.15.73:0/2482679150 learned_addr learned my addr 172.21.15.73:0/2482679150 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7ef5c7700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00e0470 0x7fe7f01af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 -- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7f00e0020 msgr2=0x7fe7f01af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7f00e0020 0x7fe7f01af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 -- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00e0470 msgr2=0x7fe7f01af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00e0470 0x7fe7f01af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 -- 172.21.15.73:0/2482679150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f01b0010 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.446 7fe7eedc6700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe7f00d46a0 tx=0x7fe7e000ed30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7f01b0010 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e000c7b0 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f00f5b00 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7e000f040 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f00f60b0 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe7e0011070 con 0x7fe7f00df3a0 2024-03-24T10:39:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.447 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe7e0010040 con 0x7fe7f00df3a0 2024-03-24T10:39:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.448 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00f08d0 con 0x7fe7f00df3a0 2024-03-24T10:39:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.451 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe7e000c5a0 con 0x7fe7f00df3a0 2024-03-24T10:39:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.476 7fc91698a700 1 Processor -- start 2024-03-24T10:39:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.476 7fc91698a700 1 -- start start 2024-03-24T10:39:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101ad770 0x7fc9101adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 0x7fc9101b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100dd400 con 0x7fc9101b4980 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100c3c60 con 0x7fc9101ae1f0 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc91698a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100dd750 con 0x7fc9101ad770 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45556/0 (socket says 172.21.15.73:45556) 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 -- 172.21.15.73:0/2472120244 learned_addr learned my addr 172.21.15.73:0/2472120244 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90fdec700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 0x7fc9101b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90f5eb700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101ad770 0x7fc9101adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 -- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101ad770 msgr2=0x7fc9101adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101ad770 0x7fc9101adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 -- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 msgr2=0x7fc9101b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.477 7fc90edea700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 0x7fc9101b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90edea700 1 -- 172.21.15.73:0/2472120244 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100d4000 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90fdec700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 0x7fc9101b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90edea700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc9100c5e30 tx=0x7fc90400c840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9100d4000 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904007240 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc91698a700 1 -- 172.21.15.73:0/2472120244 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9101bba40 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc904006710 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc91698a700 1 -- 172.21.15.73:0/2472120244 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9101bbc40 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc90401a020 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.478 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc90400bdc0 con 0x7fc9101ae1f0 2024-03-24T10:39:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.479 7fc91698a700 1 -- 172.21.15.73:0/2472120244 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9100f0850 con 0x7fc9101ae1f0 2024-03-24T10:39:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.485 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc904007030 con 0x7fc9101ae1f0 2024-03-24T10:39:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.531 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3c81aca90 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.531 7fa3c4bab700 1 -- 172.21.15.73:0/3888644505 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3c000b660 con 0x7fa3c81ab7b0 2024-03-24T10:39:30.531 INFO:teuthology.orchestra.run.smithi073.stdout:38654705669 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.532 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 >> v1:172.21.15.73:6816/43277 conn(0x7fa3a80145b0 legacy=0x7fa3a8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.532 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 msgr2=0x7fa3c81abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.532 7fa3ce746700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa3c81a6050 tx=0x7fa3c0006c40).stop 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 shutdown_connections 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa3c81b2a30 0x7fa3c81b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c81ab7b0 0x7fa3c81abc00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 --2- 172.21.15.73:0/3888644505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3c81ac230 0x7fa3c81b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 >> 172.21.15.73:0/3888644505 conn(0x7fa3c80c5b10 msgr2=0x7fa3c81a4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 shutdown_connections 2024-03-24T10:39:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.533 7fa3ce746700 1 -- 172.21.15.73:0/3888644505 wait complete. 2024-03-24T10:39:30.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.2 2024-03-24T10:39:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.567 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe7f01a4620 con 0x7fe7f00df3a0 2024-03-24T10:39:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.567 7fe7dffff700 1 -- 172.21.15.73:0/2482679150 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7e0000c30 con 0x7fe7f00df3a0 2024-03-24T10:39:30.567 INFO:teuthology.orchestra.run.smithi073.stdout:38654705668 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.568 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 >> v1:172.21.15.73:6816/43277 conn(0x7fe7cc0145b0 legacy=0x7fe7cc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.568 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 msgr2=0x7fe7f00df9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.568 7fe7f6107700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe7f00d46a0 tx=0x7fe7e000ed30).stop 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 shutdown_connections 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f00e0470 0x7fe7f01af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f00df3a0 0x7fe7f00df9f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 --2- 172.21.15.73:0/2482679150 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7f00e0020 0x7fe7f01af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 >> 172.21.15.73:0/2482679150 conn(0x7fe7f01a5820 msgr2=0x7fe7f00d76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 shutdown_connections 2024-03-24T10:39:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.569 7fe7f6107700 1 -- 172.21.15.73:0/2482679150 wait complete. 2024-03-24T10:39:30.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-03-24T10:39:30.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.598 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e200e2430 con 0x7f4e201a9e00 2024-03-24T10:39:30.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.598 7f4e0effd700 1 -- 172.21.15.73:0/1615897526 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e14000c30 con 0x7f4e201a9e00 2024-03-24T10:39:30.598 INFO:teuthology.orchestra.run.smithi073.stdout:38654705668 2024-03-24T10:39:30.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 >> v1:172.21.15.73:6816/43277 conn(0x7f4dfc0145b0 legacy=0x7f4dfc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 msgr2=0x7f4e200c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 0x7f4e200c72f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4e200c4ef0 tx=0x7f4e1400c9c0).stop 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 shutdown_connections 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e200c7920 0x7f4e201b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4e201a9380 0x7f4e201a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 --2- 172.21.15.73:0/1615897526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e201a9e00 0x7f4e200c72f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 >> 172.21.15.73:0/1615897526 conn(0x7f4e200e0560 msgr2=0x7f4e200caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 shutdown_connections 2024-03-24T10:39:30.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.600 7f4e24b38700 1 -- 172.21.15.73:0/1615897526 wait complete. 2024-03-24T10:39:30.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.3 2024-03-24T10:39:30.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.648 7fc91698a700 1 -- 172.21.15.73:0/2472120244 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9100e2430 con 0x7fc9101ae1f0 2024-03-24T10:39:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.649 7fc90cde6700 1 -- 172.21.15.73:0/2472120244 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc904000c30 con 0x7fc9101ae1f0 2024-03-24T10:39:30.649 INFO:teuthology.orchestra.run.smithi073.stdout:38654705669 2024-03-24T10:39:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 >> v1:172.21.15.73:6816/43277 conn(0x7fc8f00145b0 legacy=0x7fc8f0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 msgr2=0x7fc9101b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc9100c5e30 tx=0x7fc90400c840).stop 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 shutdown_connections 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101b4980 0x7fc9101b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101ad770 0x7fc9101adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 --2- 172.21.15.73:0/2472120244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101ae1f0 0x7fc9101b4350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 >> 172.21.15.73:0/2472120244 conn(0x7fc9100e0710 msgr2=0x7fc9101a4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 shutdown_connections 2024-03-24T10:39:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:30.650 7fc91698a700 1 -- 172.21.15.73:0/2472120244 wait complete. 2024-03-24T10:39:30.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.1 2024-03-24T10:39:31.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-24T10:39:31.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-24T10:39:31.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-24T10:39:31.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-24T10:39:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.695 7f5fa5845700 1 Processor -- start 2024-03-24T10:39:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.695 7f5fa5845700 1 -- start start 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5fa00f1e30 0x7f5fa010e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00f2280 0x7f5fa010e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00f91a0 con 0x7f5fa00f1e30 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa010ee80 con 0x7f5fa00f2280 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5fa5845700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa01aa5d0 con 0x7f5fa00f5890 2024-03-24T10:39:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60584/0 (socket says 172.21.15.73:60584) 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 -- 172.21.15.73:0/3404313962 learned_addr learned my addr 172.21.15.73:0/3404313962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9ddc4700 1 --2- 172.21.15.73:0/3404313962 >> v2:172.21.15.73:3300/0 conn(0x7f5fa00f1e30 0x7f5fa010e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 -- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00f2280 msgr2=0x7f5fa010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 --2- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00f2280 0x7f5fa010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 -- 172.21.15.73:0/3404313962 >> v2:172.21.15.73:3300/0 conn(0x7f5fa00f1e30 msgr2=0x7f5fa010e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 --2- 172.21.15.73:0/3404313962 >> v2:172.21.15.73:3300/0 conn(0x7f5fa00f1e30 0x7f5fa010e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 -- 172.21.15.73:0/3404313962 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa01aa780 con 0x7f5fa00f5890 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.696 7f5f9e5c5700 1 --2- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f880099d0).ready entity=mon.2 client_cookie=81dc3aa73baeba05 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.697 7f5f9d5c3700 1 -- 172.21.15.73:0/3404313962 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fa01aa780 con 0x7f5fa00f5890 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.697 7f5f9d5c3700 1 -- 172.21.15.73:0/3404313962 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800f510 con 0x7f5fa00f5890 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.697 7f5f9d5c3700 1 -- 172.21.15.73:0/3404313962 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f8800f6f0 con 0x7f5fa00f5890 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.697 7f5fa5845700 1 -- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 msgr2=0x7f5fa00f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.697 7f5fa5845700 1 --2- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f880099d0).stop 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 -- 172.21.15.73:0/3404313962 shutdown_connections 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 --2- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00f2280 0x7f5fa010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 --2- 172.21.15.73:0/3404313962 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00f5890 0x7f5fa00f1800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 --2- 172.21.15.73:0/3404313962 >> v2:172.21.15.73:3300/0 conn(0x7f5fa00f1e30 0x7f5fa010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 -- 172.21.15.73:0/3404313962 >> 172.21.15.73:0/3404313962 conn(0x7f5fa01139e0 msgr2=0x7f5fa00f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 -- 172.21.15.73:0/3404313962 shutdown_connections 2024-03-24T10:39:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.698 7f5fa5845700 1 -- 172.21.15.73:0/3404313962 wait complete. 2024-03-24T10:39:31.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 Processor -- start 2024-03-24T10:39:31.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 -- start start 2024-03-24T10:39:31.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 0x7f5fa00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 0x7f5fa01aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00e4270 con 0x7f5fa01aadb0 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00dd800 con 0x7f5fa00c9e20 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5fa5845700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00be9c0 con 0x7f5fa00c93a0 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5f9edc6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5f9ddc4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 0x7f5fa01aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5f9edc6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60418/0 (socket says 172.21.15.73:60418) 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.723 7f5f9edc6700 1 -- 172.21.15.73:0/3433503076 learned_addr learned my addr 172.21.15.73:0/3433503076 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9e5c5700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 0x7f5fa00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 -- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 msgr2=0x7f5fa00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 0x7f5fa00c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 -- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 msgr2=0x7f5fa01ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 -- 172.21.15.73:0/3433503076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00ddac0 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9e5c5700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 0x7f5fa00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9edc6700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f9ddc4700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 0x7f5fa01aa780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5fa00cfad0 tx=0x7f5f9000ebf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fa00ddac0 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000ee60 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa00d4c40 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f9000f040 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.724 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa01bc010 con 0x7f5fa00c9e20 2024-03-24T10:39:31.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.725 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5f90011070 con 0x7f5fa00c9e20 2024-03-24T10:39:31.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.725 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5f90010040 con 0x7f5fa00c9e20 2024-03-24T10:39:31.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.726 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa00f0850 con 0x7f5fa00c9e20 2024-03-24T10:39:31.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 Processor -- start 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 -- start start 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780f5480 0x7fb4780f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4780f9370 0x7fb47810b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47810b780 con 0x7fb4780f8f20 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb478104dc0 con 0x7fb4780f9370 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.729 7fb47f119700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb478104f70 con 0x7fb4780f5480 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4780f9370 0x7fb47810b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4780f9370 0x7fb47810b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60424/0 (socket says 172.21.15.73:60424) 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 -- 172.21.15.73:0/3689553030 learned_addr learned my addr 172.21.15.73:0/3689553030 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb4777fe700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780f5480 0x7fb4780f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 -- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780f5480 msgr2=0x7fb4780f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780f5480 0x7fb4780f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 -- 172.21.15.73:0/3689553030 >> v1:172.21.15.73:6789/0 conn(0x7fb4780f8f20 legacy=0x7fb47810a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 -- 172.21.15.73:0/3689553030 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4781a8bd0 con 0x7fb4780f9370 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb477fff700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4780f9370 0x7fb47810b150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb478105170 tx=0x7fb47000d6d0).ready entity=mon.0 client_cookie=908d1690fb5718bb server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb4767fc700 1 -- 172.21.15.73:0/3689553030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4781a8bd0 con 0x7fb4780f9370 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb4767fc700 1 -- 172.21.15.73:0/3689553030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470012070 con 0x7fb4780f9370 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb4767fc700 1 -- 172.21.15.73:0/3689553030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb470015810 con 0x7fb4780f9370 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.730 7fb47f119700 1 -- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4780f9370 msgr2=0x7fb47810b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4780f9370 0x7fb47810b150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb478105170 tx=0x7fb47000d6d0).stop 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 -- 172.21.15.73:0/3689553030 shutdown_connections 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780f5480 0x7fb4780f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 --2- 172.21.15.73:0/3689553030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4780f9370 0x7fb47810b150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 -- 172.21.15.73:0/3689553030 >> 172.21.15.73:0/3689553030 conn(0x7fb478113570 msgr2=0x7fb4780f4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 -- 172.21.15.73:0/3689553030 shutdown_connections 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.731 7fb47f119700 1 -- 172.21.15.73:0/3689553030 wait complete. 2024-03-24T10:39:31.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.732 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5f9000c540 con 0x7f5fa00c9e20 2024-03-24T10:39:31.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.754 7fb47f119700 1 Processor -- start 2024-03-24T10:39:31.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 -- start start 2024-03-24T10:39:31.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4780df7a0 0x7fb4780ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4781b04e0 0x7fb4781b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780e2d90 con 0x7fb4781b04e0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780dfed0 con 0x7fb4780df7a0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb47f119700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780dfbf0 con 0x7fb4780caea0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb476ffd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb476ffd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60608/0 (socket says 172.21.15.73:60608) 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb477fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4781b04e0 0x7fb4781b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.755 7fb476ffd700 1 -- 172.21.15.73:0/1454174043 learned_addr learned my addr 172.21.15.73:0/1454174043 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb4777fe700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4780df7a0 0x7fb4780ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 -- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4780df7a0 msgr2=0x7fb4780ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4780df7a0 0x7fb4780ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 -- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4781b04e0 msgr2=0x7fb4781b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4781b04e0 0x7fb4781b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 -- 172.21.15.73:0/1454174043 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4781b7390 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb476ffd700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb4780c5720 tx=0x7fb46c009760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4781b7390 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c00d3d0 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb47f119700 1 -- 172.21.15.73:0/1454174043 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4781b7590 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb46c00d7a0 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.756 7fb47f119700 1 -- 172.21.15.73:0/1454174043 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4781b7970 con 0x7fb4780caea0 2024-03-24T10:39:31.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.757 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb46c00d9a0 con 0x7fb4780caea0 2024-03-24T10:39:31.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.757 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb46c005bf0 con 0x7fb4780caea0 2024-03-24T10:39:31.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.757 7fb47f119700 1 -- 172.21.15.73:0/1454174043 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4781aa5d0 con 0x7fb4780caea0 2024-03-24T10:39:31.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.761 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb46c00d1c0 con 0x7fb4780caea0 2024-03-24T10:39:31.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 Processor -- start 2024-03-24T10:39:31.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 -- start start 2024-03-24T10:39:31.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 0x7fb34410a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34410b780 con 0x7fb3440f9370 2024-03-24T10:39:31.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb344104dc0 con 0x7fb3440f8f20 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb34abd6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb344104f70 con 0x7fb3440f5480 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.779 7fb3437fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60618/0 (socket says 172.21.15.73:60618) 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 -- 172.21.15.73:0/1856203518 learned_addr learned my addr 172.21.15.73:0/1856203518 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb342ffd700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 0x7fb34410a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 -- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 msgr2=0x7fb34410a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 0x7fb34410a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 -- 172.21.15.73:0/1856203518 >> v1:172.21.15.73:6789/0 conn(0x7fb3440f9370 legacy=0x7fb34410af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 -- 172.21.15.73:0/1856203518 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440f0ff0 con 0x7fb3440f5480 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb342ffd700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 0x7fb34410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3437fe700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb334002f70 tx=0x7fb334009a00).ready entity=mon.2 client_cookie=d1af7b4d68d5b47a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3427fc700 1 -- 172.21.15.73:0/1856203518 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3440f0ff0 con 0x7fb3440f5480 2024-03-24T10:39:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3427fc700 1 -- 172.21.15.73:0/1856203518 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33400f510 con 0x7fb3440f5480 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb3427fc700 1 -- 172.21.15.73:0/1856203518 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb33400f730 con 0x7fb3440f5480 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb34abd6700 1 -- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 msgr2=0x7fb3440f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.780 7fb34abd6700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb334002f70 tx=0x7fb334009a00).stop 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 -- 172.21.15.73:0/1856203518 shutdown_connections 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440f5480 0x7fb3440f88f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 --2- 172.21.15.73:0/1856203518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440f8f20 0x7fb34410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 -- 172.21.15.73:0/1856203518 >> 172.21.15.73:0/1856203518 conn(0x7fb344113570 msgr2=0x7fb3440f4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 -- 172.21.15.73:0/1856203518 shutdown_connections 2024-03-24T10:39:31.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.781 7fb34abd6700 1 -- 172.21.15.73:0/1856203518 wait complete. 2024-03-24T10:39:31.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.824 7fb34abd6700 1 Processor -- start 2024-03-24T10:39:31.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.824 7fb34abd6700 1 -- start start 2024-03-24T10:39:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440cd060 0x7fb3440d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440d50d0 0x7fb3441b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440a84d0 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440c5d10 con 0x7fb3440d50d0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb34abd6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440ba9e0 con 0x7fb3440cd060 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60450/0 (socket says 172.21.15.73:60450) 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 -- 172.21.15.73:0/2075082570 learned_addr learned my addr 172.21.15.73:0/2075082570 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 -- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440cd060 msgr2=0x7fb3440d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440cd060 0x7fb3440d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 -- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440d50d0 msgr2=0x7fb3441b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440d50d0 0x7fb3441b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.825 7fb3437fe700 1 -- 172.21.15.73:0/2075082570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440dc700 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb3437fe700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb3440bb050 tx=0x7fb3340068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3440dc700 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33401fa30 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb33401fe00 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3440ba4a0 con 0x7fb3440cc5e0 2024-03-24T10:39:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.826 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3440d5700 con 0x7fb3440cc5e0 2024-03-24T10:39:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.827 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb334011630 con 0x7fb3440cc5e0 2024-03-24T10:39:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.827 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb334024bc0 con 0x7fb3440cc5e0 2024-03-24T10:39:31.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.828 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3440f08d0 con 0x7fb3440cc5e0 2024-03-24T10:39:31.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.834 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb33400f300 con 0x7fb3440cc5e0 2024-03-24T10:39:31.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 Processor -- start 2024-03-24T10:39:31.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 -- start start 2024-03-24T10:39:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80bc0f5910 0x7f80bc0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 0x7f80bc10e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc0f9220 con 0x7f80bc0f2300 2024-03-24T10:39:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc10f0d0 con 0x7f80bc0f5910 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.846 7f80c0c7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1ac670 con 0x7f80bc0f1eb0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9a63700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80bc0f5910 0x7f80bc0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80ba264700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f80bc0f2300 0x7f80bc10e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49392/0 (socket says 172.21.15.73:49392) 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80ba264700 1 -- 172.21.15.73:0/892161150 learned_addr learned my addr 172.21.15.73:0/892161150 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 --2- 172.21.15.73:0/892161150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 0x7f80bc10e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 -- 172.21.15.73:0/892161150 >> v2:172.21.15.73:3300/0 conn(0x7f80bc0f5910 msgr2=0x7f80bc0f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 --2- 172.21.15.73:0/892161150 >> v2:172.21.15.73:3300/0 conn(0x7f80bc0f5910 0x7f80bc0f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 -- 172.21.15.73:0/892161150 >> v1:172.21.15.73:6789/0 conn(0x7f80bc0f2300 legacy=0x7f80bc10e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 -- 172.21.15.73:0/892161150 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc1ac820 con 0x7f80bc0f1eb0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b9262700 1 --2- 172.21.15.73:0/892161150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 0x7f80bc10e2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f80b0002f70 tx=0x7f80b000b970).ready entity=mon.1 client_cookie=e2db1c87b2f35080 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b8a61700 1 -- 172.21.15.73:0/892161150 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80bc1ac820 con 0x7f80bc0f1eb0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b8a61700 1 -- 172.21.15.73:0/892161150 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000d610 con 0x7f80bc0f1eb0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80b8a61700 1 -- 172.21.15.73:0/892161150 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80b000d9e0 con 0x7f80bc0f1eb0 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80c0c7b700 1 -- 172.21.15.73:0/892161150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 msgr2=0x7f80bc10e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.847 7f80c0c7b700 1 --2- 172.21.15.73:0/892161150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 0x7f80bc10e2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f80b0002f70 tx=0x7f80b000b970).stop 2024-03-24T10:39:31.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 -- 172.21.15.73:0/892161150 shutdown_connections 2024-03-24T10:39:31.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 --2- 172.21.15.73:0/892161150 >> v2:172.21.15.73:3300/0 conn(0x7f80bc0f5910 0x7f80bc0f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 --2- 172.21.15.73:0/892161150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0f1eb0 0x7f80bc10e2a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 -- 172.21.15.73:0/892161150 >> 172.21.15.73:0/892161150 conn(0x7f80bc113a60 msgr2=0x7f80bc0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 -- 172.21.15.73:0/892161150 shutdown_connections 2024-03-24T10:39:31.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.848 7f80c0c7b700 1 -- 172.21.15.73:0/892161150 wait complete. 2024-03-24T10:39:31.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.871 7f80c0c7b700 1 Processor -- start 2024-03-24T10:39:31.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.871 7f80c0c7b700 1 -- start start 2024-03-24T10:39:31.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0cbe40 0x7f80bc1b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80bc1b4960 0x7f80bc1b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0effd0 con 0x7f80bc1b4960 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0bc5a0 con 0x7f80bc0cbe40 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80c0c7b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0cea80 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60628/0 (socket says 172.21.15.73:60628) 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 -- 172.21.15.73:0/3997672971 learned_addr learned my addr 172.21.15.73:0/3997672971 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80ba264700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80bc1b4960 0x7f80bc1b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9262700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0cbe40 0x7f80bc1b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 -- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0cbe40 msgr2=0x7f80bc1b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0cbe40 0x7f80bc1b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 -- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80bc1b4960 msgr2=0x7f80bc1b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80bc1b4960 0x7f80bc1b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.872 7f80b9a63700 1 -- 172.21.15.73:0/3997672971 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0ce1e0 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80b9a63700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f80bc0c35b0 tx=0x7f80ac00ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80bc0ce1e0 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00ca20 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f80ac00f040 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc0cdf20 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.873 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc1bba20 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.874 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f80ac011070 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.874 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f80ac010040 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.874 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc0f08d0 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.881 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f80ac00c620 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.891 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5fa00e2430 con 0x7f5fa00c9e20 2024-03-24T10:39:31.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.891 7f5f977fe700 1 -- 172.21.15.73:0/3433503076 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f90000c30 con 0x7f5fa00c9e20 2024-03-24T10:39:31.891 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 >> v1:172.21.15.73:6816/43277 conn(0x7f5f840145b0 legacy=0x7f5f84016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 msgr2=0x7f5fa01aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 0x7f5fa01aa780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5fa00cfad0 tx=0x7f5f9000ebf0).stop 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 shutdown_connections 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fa01aadb0 0x7f5fa01ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5fa00c93a0 0x7f5fa00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 --2- 172.21.15.73:0/3433503076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fa00c9e20 0x7f5fa01aa780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 >> 172.21.15.73:0/3433503076 conn(0x7f5fa00dea90 msgr2=0x7f5fa00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.893 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 shutdown_connections 2024-03-24T10:39:31.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.894 7f5fa5845700 1 -- 172.21.15.73:0/3433503076 wait complete. 2024-03-24T10:39:31.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-03-24T10:39:31.905 DEBUG:teuthology.parallel:result is None 2024-03-24T10:39:31.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.908 7fb47f119700 1 -- 172.21.15.73:0/1454174043 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4780a6080 con 0x7fb4780caea0 2024-03-24T10:39:31.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.908 7fb474ff9700 1 -- 172.21.15.73:0/1454174043 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4780f2db0 con 0x7fb4780caea0 2024-03-24T10:39:31.908 INFO:teuthology.orchestra.run.smithi073.stdout:38654705670 2024-03-24T10:39:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 >> v1:172.21.15.73:6816/43277 conn(0x7fb4580145b0 legacy=0x7fb458016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 msgr2=0x7fb4781afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb4780c5720 tx=0x7fb46c009760).stop 2024-03-24T10:39:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 shutdown_connections 2024-03-24T10:39:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4781b04e0 0x7fb4781b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4780df7a0 0x7fb4780ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 --2- 172.21.15.73:0/1454174043 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4780caea0 0x7fb4781afeb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 >> 172.21.15.73:0/1454174043 conn(0x7fb4780c4f20 msgr2=0x7fb4780d6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 shutdown_connections 2024-03-24T10:39:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.910 7fb47f119700 1 -- 172.21.15.73:0/1454174043 wait complete. 2024-03-24T10:39:31.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-03-24T10:39:31.921 DEBUG:teuthology.parallel:result is None 2024-03-24T10:39:31.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.947 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3440d6920 con 0x7fb3440cc5e0 2024-03-24T10:39:31.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.947 7fb340ff9700 1 -- 172.21.15.73:0/2075082570 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb33401f820 con 0x7fb3440cc5e0 2024-03-24T10:39:31.948 INFO:teuthology.orchestra.run.smithi073.stdout:38654705670 2024-03-24T10:39:31.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 >> v1:172.21.15.73:6816/43277 conn(0x7fb324014600 legacy=0x7fb324016b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 msgr2=0x7fb3440cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb3440bb050 tx=0x7fb3340068c0).stop 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 shutdown_connections 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3440d50d0 0x7fb3441b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3440cc5e0 0x7fb3440cca30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 --2- 172.21.15.73:0/2075082570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb3440cd060 0x7fb3440d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 >> 172.21.15.73:0/2075082570 conn(0x7fb3440dab00 msgr2=0x7fb3440bf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 shutdown_connections 2024-03-24T10:39:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.949 7fb34abd6700 1 -- 172.21.15.73:0/2075082570 wait complete. 2024-03-24T10:39:31.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-03-24T10:39:31.960 DEBUG:teuthology.parallel:result is None 2024-03-24T10:39:31.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.992 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80bc1aea70 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.993 7f80aaffd700 1 -- 172.21.15.73:0/3997672971 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80ac000c30 con 0x7f80bc0cb3c0 2024-03-24T10:39:31.993 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 >> v1:172.21.15.73:6816/43277 conn(0x7f80980145b0 legacy=0x7f8098016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 msgr2=0x7f80bc0cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f80bc0c35b0 tx=0x7f80ac00ec80).stop 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 shutdown_connections 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80bc1b4960 0x7f80bc1b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f80bc0cb3c0 0x7f80bc0cb810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 --2- 172.21.15.73:0/3997672971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80bc0cbe40 0x7f80bc1b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 >> 172.21.15.73:0/3997672971 conn(0x7f80bc0dc710 msgr2=0x7f80bc0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 shutdown_connections 2024-03-24T10:39:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:31.994 7f80c0c7b700 1 -- 172.21.15.73:0/3997672971 wait complete. 2024-03-24T10:39:32.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-03-24T10:39:32.005 DEBUG:teuthology.parallel:result is None 2024-03-24T10:39:32.005 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-24T10:39:32.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:32.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.171 7f1ee808a700 1 Processor -- start 2024-03-24T10:39:32.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 -- start start 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 0x7f1ee01a5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ee01a5e50 0x7f1ee01a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee010bd50 con 0x7f1ee010b100 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee0104bd0 con 0x7f1ee01a5e50 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee808a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00f5090 con 0x7f1ee01a33c0 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee4e85700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1ee010b100 0x7f1ee010b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49396/0 (socket says 172.21.15.73:49396) 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1ee4e85700 1 -- 172.21.15.73:0/2224545773 learned_addr learned my addr 172.21.15.73:0/2224545773 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edffff700 1 --2- 172.21.15.73:0/2224545773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 0x7f1ee01a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edffff700 1 -- 172.21.15.73:0/2224545773 >> v2:172.21.15.73:3300/0 conn(0x7f1ee01a5e50 msgr2=0x7f1ee01a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edf7fe700 1 -- 172.21.15.73:0/2224545773 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363886761 0 0) 0x7f1ed4001110 con 0x7f1ee010b100 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edffff700 1 --2- 172.21.15.73:0/2224545773 >> v2:172.21.15.73:3300/0 conn(0x7f1ee01a5e50 0x7f1ee01a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edffff700 1 -- 172.21.15.73:0/2224545773 >> v1:172.21.15.73:6789/0 conn(0x7f1ee010b100 legacy=0x7f1ee010b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.172 7f1edffff700 1 -- 172.21.15.73:0/2224545773 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee01a98f0 con 0x7f1ee01a33c0 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1edffff700 1 --2- 172.21.15.73:0/2224545773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 0x7f1ee01a5820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1ecc002f70 tx=0x7f1ecc00b970).ready entity=mon.2 client_cookie=b3ed15b6d4a7b1a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1edf7fe700 1 -- 172.21.15.73:0/2224545773 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee01a98f0 con 0x7f1ee01a33c0 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1edf7fe700 1 -- 172.21.15.73:0/2224545773 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00f9c0 con 0x7f1ee01a33c0 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1edf7fe700 1 -- 172.21.15.73:0/2224545773 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ecc015070 con 0x7f1ee01a33c0 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1ee808a700 1 -- 172.21.15.73:0/2224545773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 msgr2=0x7f1ee01a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.173 7f1ee808a700 1 --2- 172.21.15.73:0/2224545773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 0x7f1ee01a5820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1ecc002f70 tx=0x7f1ecc00b970).stop 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 -- 172.21.15.73:0/2224545773 shutdown_connections 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 --2- 172.21.15.73:0/2224545773 >> v2:172.21.15.73:3300/0 conn(0x7f1ee01a5e50 0x7f1ee01a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 --2- 172.21.15.73:0/2224545773 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a33c0 0x7f1ee01a5820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 -- 172.21.15.73:0/2224545773 >> 172.21.15.73:0/2224545773 conn(0x7f1ee0112f10 msgr2=0x7f1ee00f4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 -- 172.21.15.73:0/2224545773 shutdown_connections 2024-03-24T10:39:32.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.174 7f1ee808a700 1 -- 172.21.15.73:0/2224545773 wait complete. 2024-03-24T10:39:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.196 7f1ee808a700 1 Processor -- start 2024-03-24T10:39:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.196 7f1ee808a700 1 -- start start 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 0x7f1ee01a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 0x7f1ee01b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00f0600 con 0x7f1ee01a3700 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00d9640 con 0x7f1ee00d8bf0 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00dd2c0 con 0x7f1ee01a32b0 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee4e85700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 0x7f1ee01a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60658/0 (socket says 172.21.15.73:60658) 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee4e85700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 0x7f1ee01a2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45622/0 (socket says 172.21.15.73:45622) 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 -- 172.21.15.73:0/2118750187 learned_addr learned my addr 172.21.15.73:0/2118750187 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee5686700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 0x7f1ee01b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 -- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 msgr2=0x7f1ee01a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 0x7f1ee01a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 -- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 msgr2=0x7f1ee01b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 0x7f1ee01b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 -- 172.21.15.73:0/2118750187 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee01b0b70 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee5686700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 0x7f1ee01b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1edffff700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1ee00e6870 tx=0x7f1ecc0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee01b0b70 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc010d50 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee01b0e30 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.197 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ecc01a670 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.198 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee01b78f0 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.198 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1ecc01a870 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.198 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1ecc00adc0 con 0x7f1ee01a32b0 2024-03-24T10:39:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.199 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee01aa670 con 0x7f1ee01a32b0 2024-03-24T10:39:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.202 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1ecc010950 con 0x7f1ee01a32b0 2024-03-24T10:39:32.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.302 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f1ee0087810 con 0x7f1ec80145b0 2024-03-24T10:39:32.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.310 7f1eddffb700 1 -- 172.21.15.73:0/2118750187 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306106 (unknown 2965378022 0 249926616) 0x7f1ed4001210 con 0x7f1ec80145b0 2024-03-24T10:39:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 >> v1:172.21.15.73:6816/43277 conn(0x7f1ec80145b0 legacy=0x7f1ec8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 msgr2=0x7f1ee01aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1ee00e6870 tx=0x7f1ecc0068c0).stop 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 shutdown_connections 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee01a3700 0x7f1ee01b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ee00d8bf0 0x7f1ee01a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 --2- 172.21.15.73:0/2118750187 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1ee01a32b0 0x7f1ee01aff10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 >> 172.21.15.73:0/2118750187 conn(0x7f1ee00c5810 msgr2=0x7f1ee00c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 shutdown_connections 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.313 7f1ee808a700 1 -- 172.21.15.73:0/2118750187 wait complete. 2024-03-24T10:39:32.316 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-24 10:39:31.113596","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001190"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743122","last_change":"2024-03-24 10:39:21.733062","last_active":"2024-03-24 10:39:21.743122","last_peered":"2024-03-24 10:39:21.743122","last_clean":"2024-03-24 10:39:21.743122","last_became_active":"2024-03-24 10:39:21.732749","last_became_peered":"2024-03-24 10:39:21.732749","last_unstale":"2024-03-24 10:39:21.743122","last_undegraded":"2024-03-24 10:39:21.743122","last_fullsized":"2024-03-24 10:39:21.743122","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723064","last_change":"2024-03-24 10:39:21.410484","last_active":"2024-03-24 10:39:21.723064","last_peered":"2024-03-24 10:39:21.723064","last_clean":"2024-03-24 10:39:21.723064","last_became_active":"2024-03-24 10:39:21.410014","last_became_peered":"2024-03-24 10:39:21.410014","last_unstale":"2024-03-24 10:39:21.723064","last_undegraded":"2024-03-24 10:39:21.723064","last_fullsized":"2024-03-24 10:39:21.723064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756881","last_change":"2024-03-24 10:39:21.754967","last_active":"2024-03-24 10:39:21.756881","last_peered":"2024-03-24 10:39:21.756881","last_clean":"2024-03-24 10:39:21.756881","last_became_active":"2024-03-24 10:39:21.754511","last_became_peered":"2024-03-24 10:39:21.754511","last_unstale":"2024-03-24 10:39:21.756881","last_undegraded":"2024-03-24 10:39:21.756881","last_fullsized":"2024-03-24 10:39:21.756881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722751","last_change":"2024-03-24 10:39:21.405477","last_active":"2024-03-24 10:39:21.722751","last_peered":"2024-03-24 10:39:21.722751","last_clean":"2024-03-24 10:39:21.722751","last_became_active":"2024-03-24 10:39:21.405145","last_became_peered":"2024-03-24 10:39:21.405145","last_unstale":"2024-03-24 10:39:21.722751","last_undegraded":"2024-03-24 10:39:21.722751","last_fullsized":"2024-03-24 10:39:21.722751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750731","last_change":"2024-03-24 10:39:21.749349","last_active":"2024-03-24 10:39:21.750731","last_peered":"2024-03-24 10:39:21.750731","last_clean":"2024-03-24 10:39:21.750731","last_became_active":"2024-03-24 10:39:21.749024","last_became_peered":"2024-03-24 10:39:21.749024","last_unstale":"2024-03-24 10:39:21.750731","last_undegraded":"2024-03-24 10:39:21.750731","last_fullsized":"2024-03-24 10:39:21.750731","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724246","last_change":"2024-03-24 10:39:21.405055","last_active":"2024-03-24 10:39:21.724246","last_peered":"2024-03-24 10:39:21.724246","last_clean":"2024-03-24 10:39:21.724246","last_became_active":"2024-03-24 10:39:21.404748","last_became_peered":"2024-03-24 10:39:21.404748","last_unstale":"2024-03-24 10:39:21.724246","last_undegraded":"2024-03-24 10:39:21.724246","last_fullsized":"2024-03-24 10:39:21.724246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745143","last_change":"2024-03-24 10:39:21.742175","last_active":"2024-03-24 10:39:21.745143","last_peered":"2024-03-24 10:39:21.745143","last_clean":"2024-03-24 10:39:21.745143","last_became_active":"2024-03-24 10:39:21.741904","last_became_peered":"2024-03-24 10:39:21.741904","last_unstale":"2024-03-24 10:39:21.745143","last_undegraded":"2024-03-24 10:39:21.745143","last_fullsized":"2024-03-24 10:39:21.745143","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721675","last_change":"2024-03-24 10:39:21.405185","last_active":"2024-03-24 10:39:21.721675","last_peered":"2024-03-24 10:39:21.721675","last_clean":"2024-03-24 10:39:21.721675","last_became_active":"2024-03-24 10:39:21.404576","last_became_peered":"2024-03-24 10:39:21.404576","last_unstale":"2024-03-24 10:39:21.721675","last_undegraded":"2024-03-24 10:39:21.721675","last_fullsized":"2024-03-24 10:39:21.721675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755187","last_change":"2024-03-24 10:39:21.751864","last_active":"2024-03-24 10:39:21.755187","last_peered":"2024-03-24 10:39:21.755187","last_clean":"2024-03-24 10:39:21.755187","last_became_active":"2024-03-24 10:39:21.751297","last_became_peered":"2024-03-24 10:39:21.751297","last_unstale":"2024-03-24 10:39:21.755187","last_undegraded":"2024-03-24 10:39:21.755187","last_fullsized":"2024-03-24 10:39:21.755187","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724589","last_change":"2024-03-24 10:39:21.393191","last_active":"2024-03-24 10:39:21.724589","last_peered":"2024-03-24 10:39:21.724589","last_clean":"2024-03-24 10:39:21.724589","last_became_active":"2024-03-24 10:39:21.392863","last_became_peered":"2024-03-24 10:39:21.392863","last_unstale":"2024-03-24 10:39:21.724589","last_undegraded":"2024-03-24 10:39:21.724589","last_fullsized":"2024-03-24 10:39:21.724589","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756489","last_change":"2024-03-24 10:39:21.753654","last_active":"2024-03-24 10:39:21.756489","last_peered":"2024-03-24 10:39:21.756489","last_clean":"2024-03-24 10:39:21.756489","last_became_active":"2024-03-24 10:39:21.753306","last_became_peered":"2024-03-24 10:39:21.753306","last_unstale":"2024-03-24 10:39:21.756489","last_undegraded":"2024-03-24 10:39:21.756489","last_fullsized":"2024-03-24 10:39:21.756489","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729807","last_change":"2024-03-24 10:39:21.398093","last_active":"2024-03-24 10:39:21.729807","last_peered":"2024-03-24 10:39:21.729807","last_clean":"2024-03-24 10:39:21.729807","last_became_active":"2024-03-24 10:39:21.397415","last_became_peered":"2024-03-24 10:39:21.397415","last_unstale":"2024-03-24 10:39:21.729807","last_undegraded":"2024-03-24 10:39:21.729807","last_fullsized":"2024-03-24 10:39:21.729807","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748438","last_change":"2024-03-24 10:39:21.746784","last_active":"2024-03-24 10:39:21.748438","last_peered":"2024-03-24 10:39:21.748438","last_clean":"2024-03-24 10:39:21.748438","last_became_active":"2024-03-24 10:39:21.746406","last_became_peered":"2024-03-24 10:39:21.746406","last_unstale":"2024-03-24 10:39:21.748438","last_undegraded":"2024-03-24 10:39:21.748438","last_fullsized":"2024-03-24 10:39:21.748438","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748529","last_change":"2024-03-24 10:39:21.407422","last_active":"2024-03-24 10:39:21.748529","last_peered":"2024-03-24 10:39:21.748529","last_clean":"2024-03-24 10:39:21.748529","last_became_active":"2024-03-24 10:39:21.407030","last_became_peered":"2024-03-24 10:39:21.407030","last_unstale":"2024-03-24 10:39:21.748529","last_undegraded":"2024-03-24 10:39:21.748529","last_fullsized":"2024-03-24 10:39:21.748529","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756688","last_change":"2024-03-24 10:39:21.754359","last_active":"2024-03-24 10:39:21.756688","last_peered":"2024-03-24 10:39:21.756688","last_clean":"2024-03-24 10:39:21.756688","last_became_active":"2024-03-24 10:39:21.754061","last_became_peered":"2024-03-24 10:39:21.754061","last_unstale":"2024-03-24 10:39:21.756688","last_undegraded":"2024-03-24 10:39:21.756688","last_fullsized":"2024-03-24 10:39:21.756688","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750719","last_change":"2024-03-24 10:39:21.389253","last_active":"2024-03-24 10:39:21.750719","last_peered":"2024-03-24 10:39:21.750719","last_clean":"2024-03-24 10:39:21.750719","last_became_active":"2024-03-24 10:39:21.388938","last_became_peered":"2024-03-24 10:39:21.388938","last_unstale":"2024-03-24 10:39:21.750719","last_undegraded":"2024-03-24 10:39:21.750719","last_fullsized":"2024-03-24 10:39:21.750719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748240","last_change":"2024-03-24 10:39:21.743588","last_active":"2024-03-24 10:39:21.748240","last_peered":"2024-03-24 10:39:21.748240","last_clean":"2024-03-24 10:39:21.748240","last_became_active":"2024-03-24 10:39:21.742056","last_became_peered":"2024-03-24 10:39:21.742056","last_unstale":"2024-03-24 10:39:21.748240","last_undegraded":"2024-03-24 10:39:21.748240","last_fullsized":"2024-03-24 10:39:21.748240","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755402","last_change":"2024-03-24 10:39:21.413014","last_active":"2024-03-24 10:39:21.755402","last_peered":"2024-03-24 10:39:21.755402","last_clean":"2024-03-24 10:39:21.755402","last_became_active":"2024-03-24 10:39:21.412716","last_became_peered":"2024-03-24 10:39:21.412716","last_unstale":"2024-03-24 10:39:21.755402","last_undegraded":"2024-03-24 10:39:21.755402","last_fullsized":"2024-03-24 10:39:21.755402","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756575","last_change":"2024-03-24 10:39:21.751937","last_active":"2024-03-24 10:39:21.756575","last_peered":"2024-03-24 10:39:21.756575","last_clean":"2024-03-24 10:39:21.756575","last_became_active":"2024-03-24 10:39:21.751709","last_became_peered":"2024-03-24 10:39:21.751709","last_unstale":"2024-03-24 10:39:21.756575","last_undegraded":"2024-03-24 10:39:21.756575","last_fullsized":"2024-03-24 10:39:21.756575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722537","last_change":"2024-03-24 10:39:21.409360","last_active":"2024-03-24 10:39:21.722537","last_peered":"2024-03-24 10:39:21.722537","last_clean":"2024-03-24 10:39:21.722537","last_became_active":"2024-03-24 10:39:21.409159","last_became_peered":"2024-03-24 10:39:21.409159","last_unstale":"2024-03-24 10:39:21.722537","last_undegraded":"2024-03-24 10:39:21.722537","last_fullsized":"2024-03-24 10:39:21.722537","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743861","last_change":"2024-03-24 10:39:21.733813","last_active":"2024-03-24 10:39:21.743861","last_peered":"2024-03-24 10:39:21.743861","last_clean":"2024-03-24 10:39:21.743861","last_became_active":"2024-03-24 10:39:21.733530","last_became_peered":"2024-03-24 10:39:21.733530","last_unstale":"2024-03-24 10:39:21.743861","last_undegraded":"2024-03-24 10:39:21.743861","last_fullsized":"2024-03-24 10:39:21.743861","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725758","last_change":"2024-03-24 10:39:21.412405","last_active":"2024-03-24 10:39:21.725758","last_peered":"2024-03-24 10:39:21.725758","last_clean":"2024-03-24 10:39:21.725758","last_became_active":"2024-03-24 10:39:21.412066","last_became_peered":"2024-03-24 10:39:21.412066","last_unstale":"2024-03-24 10:39:21.725758","last_undegraded":"2024-03-24 10:39:21.725758","last_fullsized":"2024-03-24 10:39:21.725758","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749646","last_change":"2024-03-24 10:39:21.746871","last_active":"2024-03-24 10:39:21.749646","last_peered":"2024-03-24 10:39:21.749646","last_clean":"2024-03-24 10:39:21.749646","last_became_active":"2024-03-24 10:39:21.746393","last_became_peered":"2024-03-24 10:39:21.746393","last_unstale":"2024-03-24 10:39:21.749646","last_undegraded":"2024-03-24 10:39:21.749646","last_fullsized":"2024-03-24 10:39:21.749646","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745363","last_change":"2024-03-24 10:39:21.386589","last_active":"2024-03-24 10:39:21.745363","last_peered":"2024-03-24 10:39:21.745363","last_clean":"2024-03-24 10:39:21.745363","last_became_active":"2024-03-24 10:39:21.386295","last_became_peered":"2024-03-24 10:39:21.386295","last_unstale":"2024-03-24 10:39:21.745363","last_undegraded":"2024-03-24 10:39:21.745363","last_fullsized":"2024-03-24 10:39:21.745363","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744247","last_change":"2024-03-24 10:39:21.733805","last_active":"2024-03-24 10:39:21.744247","last_peered":"2024-03-24 10:39:21.744247","last_clean":"2024-03-24 10:39:21.744247","last_became_active":"2024-03-24 10:39:21.733501","last_became_peered":"2024-03-24 10:39:21.733501","last_unstale":"2024-03-24 10:39:21.744247","last_undegraded":"2024-03-24 10:39:21.744247","last_fullsized":"2024-03-24 10:39:21.744247","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747691","last_change":"2024-03-24 10:39:21.398400","last_active":"2024-03-24 10:39:21.747691","last_peered":"2024-03-24 10:39:21.747691","last_clean":"2024-03-24 10:39:21.747691","last_became_active":"2024-03-24 10:39:21.397859","last_became_peered":"2024-03-24 10:39:21.397859","last_unstale":"2024-03-24 10:39:21.747691","last_undegraded":"2024-03-24 10:39:21.747691","last_fullsized":"2024-03-24 10:39:21.747691","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747817","last_change":"2024-03-24 10:39:21.741686","last_active":"2024-03-24 10:39:21.747817","last_peered":"2024-03-24 10:39:21.747817","last_clean":"2024-03-24 10:39:21.747817","last_became_active":"2024-03-24 10:39:21.741119","last_became_peered":"2024-03-24 10:39:21.741119","last_unstale":"2024-03-24 10:39:21.747817","last_undegraded":"2024-03-24 10:39:21.747817","last_fullsized":"2024-03-24 10:39:21.747817","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752068","last_change":"2024-03-24 10:39:21.389678","last_active":"2024-03-24 10:39:21.752068","last_peered":"2024-03-24 10:39:21.752068","last_clean":"2024-03-24 10:39:21.752068","last_became_active":"2024-03-24 10:39:21.389377","last_became_peered":"2024-03-24 10:39:21.389377","last_unstale":"2024-03-24 10:39:21.752068","last_undegraded":"2024-03-24 10:39:21.752068","last_fullsized":"2024-03-24 10:39:21.752068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748099","last_change":"2024-03-24 10:39:21.742841","last_active":"2024-03-24 10:39:21.748099","last_peered":"2024-03-24 10:39:21.748099","last_clean":"2024-03-24 10:39:21.748099","last_became_active":"2024-03-24 10:39:21.742567","last_became_peered":"2024-03-24 10:39:21.742567","last_unstale":"2024-03-24 10:39:21.748099","last_undegraded":"2024-03-24 10:39:21.748099","last_fullsized":"2024-03-24 10:39:21.748099","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722471","last_change":"2024-03-24 10:39:21.407601","last_active":"2024-03-24 10:39:21.722471","last_peered":"2024-03-24 10:39:21.722471","last_clean":"2024-03-24 10:39:21.722471","last_became_active":"2024-03-24 10:39:21.407123","last_became_peered":"2024-03-24 10:39:21.407123","last_unstale":"2024-03-24 10:39:21.722471","last_undegraded":"2024-03-24 10:39:21.722471","last_fullsized":"2024-03-24 10:39:21.722471","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747918","last_change":"2024-03-24 10:39:21.741427","last_active":"2024-03-24 10:39:21.747918","last_peered":"2024-03-24 10:39:21.747918","last_clean":"2024-03-24 10:39:21.747918","last_became_active":"2024-03-24 10:39:21.741202","last_became_peered":"2024-03-24 10:39:21.741202","last_unstale":"2024-03-24 10:39:21.747918","last_undegraded":"2024-03-24 10:39:21.747918","last_fullsized":"2024-03-24 10:39:21.747918","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716544","last_change":"2024-03-24 10:39:21.397164","last_active":"2024-03-24 10:39:21.716544","last_peered":"2024-03-24 10:39:21.716544","last_clean":"2024-03-24 10:39:21.716544","last_became_active":"2024-03-24 10:39:21.396867","last_became_peered":"2024-03-24 10:39:21.396867","last_unstale":"2024-03-24 10:39:21.716544","last_undegraded":"2024-03-24 10:39:21.716544","last_fullsized":"2024-03-24 10:39:21.716544","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747260","last_change":"2024-03-24 10:39:21.740995","last_active":"2024-03-24 10:39:21.747260","last_peered":"2024-03-24 10:39:21.747260","last_clean":"2024-03-24 10:39:21.747260","last_became_active":"2024-03-24 10:39:21.740697","last_became_peered":"2024-03-24 10:39:21.740697","last_unstale":"2024-03-24 10:39:21.747260","last_undegraded":"2024-03-24 10:39:21.747260","last_fullsized":"2024-03-24 10:39:21.747260","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749980","last_change":"2024-03-24 10:39:21.411252","last_active":"2024-03-24 10:39:21.749980","last_peered":"2024-03-24 10:39:21.749980","last_clean":"2024-03-24 10:39:21.749980","last_became_active":"2024-03-24 10:39:21.410965","last_became_peered":"2024-03-24 10:39:21.410965","last_unstale":"2024-03-24 10:39:21.749980","last_undegraded":"2024-03-24 10:39:21.749980","last_fullsized":"2024-03-24 10:39:21.749980","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750603","last_change":"2024-03-24 10:39:21.749883","last_active":"2024-03-24 10:39:21.750603","last_peered":"2024-03-24 10:39:21.750603","last_clean":"2024-03-24 10:39:21.750603","last_became_active":"2024-03-24 10:39:21.749521","last_became_peered":"2024-03-24 10:39:21.749521","last_unstale":"2024-03-24 10:39:21.750603","last_undegraded":"2024-03-24 10:39:21.750603","last_fullsized":"2024-03-24 10:39:21.750603","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725159","last_change":"2024-03-24 10:39:21.396016","last_active":"2024-03-24 10:39:21.725159","last_peered":"2024-03-24 10:39:21.725159","last_clean":"2024-03-24 10:39:21.725159","last_became_active":"2024-03-24 10:39:21.395496","last_became_peered":"2024-03-24 10:39:21.395496","last_unstale":"2024-03-24 10:39:21.725159","last_undegraded":"2024-03-24 10:39:21.725159","last_fullsized":"2024-03-24 10:39:21.725159","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748341","last_change":"2024-03-24 10:39:21.741529","last_active":"2024-03-24 10:39:21.748341","last_peered":"2024-03-24 10:39:21.748341","last_clean":"2024-03-24 10:39:21.748341","last_became_active":"2024-03-24 10:39:21.741235","last_became_peered":"2024-03-24 10:39:21.741235","last_unstale":"2024-03-24 10:39:21.748341","last_undegraded":"2024-03-24 10:39:21.748341","last_fullsized":"2024-03-24 10:39:21.748341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.719089","last_change":"2024-03-24 10:39:21.401865","last_active":"2024-03-24 10:39:21.719089","last_peered":"2024-03-24 10:39:21.719089","last_clean":"2024-03-24 10:39:21.719089","last_became_active":"2024-03-24 10:39:21.401590","last_became_peered":"2024-03-24 10:39:21.401590","last_unstale":"2024-03-24 10:39:21.719089","last_undegraded":"2024-03-24 10:39:21.719089","last_fullsized":"2024-03-24 10:39:21.719089","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749696","last_change":"2024-03-24 10:39:21.747518","last_active":"2024-03-24 10:39:21.749696","last_peered":"2024-03-24 10:39:21.749696","last_clean":"2024-03-24 10:39:21.749696","last_became_active":"2024-03-24 10:39:21.746543","last_became_peered":"2024-03-24 10:39:21.746543","last_unstale":"2024-03-24 10:39:21.749696","last_undegraded":"2024-03-24 10:39:21.749696","last_fullsized":"2024-03-24 10:39:21.749696","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723834","last_change":"2024-03-24 10:39:21.398690","last_active":"2024-03-24 10:39:21.723834","last_peered":"2024-03-24 10:39:21.723834","last_clean":"2024-03-24 10:39:21.723834","last_became_active":"2024-03-24 10:39:21.398369","last_became_peered":"2024-03-24 10:39:21.398369","last_unstale":"2024-03-24 10:39:21.723834","last_undegraded":"2024-03-24 10:39:21.723834","last_fullsized":"2024-03-24 10:39:21.723834","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748298","last_change":"2024-03-24 10:39:21.745829","last_active":"2024-03-24 10:39:21.748298","last_peered":"2024-03-24 10:39:21.748298","last_clean":"2024-03-24 10:39:21.748298","last_became_active":"2024-03-24 10:39:21.745472","last_became_peered":"2024-03-24 10:39:21.745472","last_unstale":"2024-03-24 10:39:21.748298","last_undegraded":"2024-03-24 10:39:21.748298","last_fullsized":"2024-03-24 10:39:21.748298","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718093","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:21.718093","last_peered":"2024-03-24 10:39:21.718093","last_clean":"2024-03-24 10:39:21.718093","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:21.718093","last_undegraded":"2024-03-24 10:39:21.718093","last_fullsized":"2024-03-24 10:39:21.718093","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724305","last_change":"2024-03-24 10:39:21.400473","last_active":"2024-03-24 10:39:21.724305","last_peered":"2024-03-24 10:39:21.724305","last_clean":"2024-03-24 10:39:21.724305","last_became_active":"2024-03-24 10:39:21.400199","last_became_peered":"2024-03-24 10:39:21.400199","last_unstale":"2024-03-24 10:39:21.724305","last_undegraded":"2024-03-24 10:39:21.724305","last_fullsized":"2024-03-24 10:39:21.724305","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748222","last_change":"2024-03-24 10:39:21.743515","last_active":"2024-03-24 10:39:21.748222","last_peered":"2024-03-24 10:39:21.748222","last_clean":"2024-03-24 10:39:21.748222","last_became_active":"2024-03-24 10:39:21.740628","last_became_peered":"2024-03-24 10:39:21.740628","last_unstale":"2024-03-24 10:39:21.748222","last_undegraded":"2024-03-24 10:39:21.748222","last_fullsized":"2024-03-24 10:39:21.748222","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726669","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:21.726669","last_peered":"2024-03-24 10:39:21.726669","last_clean":"2024-03-24 10:39:21.726669","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:21.726669","last_undegraded":"2024-03-24 10:39:21.726669","last_fullsized":"2024-03-24 10:39:21.726669","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751900","last_change":"2024-03-24 10:39:21.410337","last_active":"2024-03-24 10:39:21.751900","last_peered":"2024-03-24 10:39:21.751900","last_clean":"2024-03-24 10:39:21.751900","last_became_active":"2024-03-24 10:39:21.410037","last_became_peered":"2024-03-24 10:39:21.410037","last_unstale":"2024-03-24 10:39:21.751900","last_undegraded":"2024-03-24 10:39:21.751900","last_fullsized":"2024-03-24 10:39:21.751900","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722808","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:21.722808","last_peered":"2024-03-24 10:39:21.722808","last_clean":"2024-03-24 10:39:21.722808","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:21.722808","last_undegraded":"2024-03-24 10:39:21.722808","last_fullsized":"2024-03-24 10:39:21.722808","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721775","last_change":"2024-03-24 10:39:21.405373","last_active":"2024-03-24 10:39:21.721775","last_peered":"2024-03-24 10:39:21.721775","last_clean":"2024-03-24 10:39:21.721775","last_became_active":"2024-03-24 10:39:21.404592","last_became_peered":"2024-03-24 10:39:21.404592","last_unstale":"2024-03-24 10:39:21.721775","last_undegraded":"2024-03-24 10:39:21.721775","last_fullsized":"2024-03-24 10:39:21.721775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745772","last_change":"2024-03-24 10:39:21.736241","last_active":"2024-03-24 10:39:21.745772","last_peered":"2024-03-24 10:39:21.745772","last_clean":"2024-03-24 10:39:21.745772","last_became_active":"2024-03-24 10:39:21.732484","last_became_peered":"2024-03-24 10:39:21.732484","last_unstale":"2024-03-24 10:39:21.745772","last_undegraded":"2024-03-24 10:39:21.745772","last_fullsized":"2024-03-24 10:39:21.745772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726569","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:21.726569","last_peered":"2024-03-24 10:39:21.726569","last_clean":"2024-03-24 10:39:21.726569","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:21.726569","last_undegraded":"2024-03-24 10:39:21.726569","last_fullsized":"2024-03-24 10:39:21.726569","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715418","last_change":"2024-03-24 10:39:21.386180","last_active":"2024-03-24 10:39:21.715418","last_peered":"2024-03-24 10:39:21.715418","last_clean":"2024-03-24 10:39:21.715418","last_became_active":"2024-03-24 10:39:21.385860","last_became_peered":"2024-03-24 10:39:21.385860","last_unstale":"2024-03-24 10:39:21.715418","last_undegraded":"2024-03-24 10:39:21.715418","last_fullsized":"2024-03-24 10:39:21.715418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743840","last_change":"2024-03-24 10:39:21.733305","last_active":"2024-03-24 10:39:21.743840","last_peered":"2024-03-24 10:39:21.743840","last_clean":"2024-03-24 10:39:21.743840","last_became_active":"2024-03-24 10:39:21.732991","last_became_peered":"2024-03-24 10:39:21.732991","last_unstale":"2024-03-24 10:39:21.743840","last_undegraded":"2024-03-24 10:39:21.743840","last_fullsized":"2024-03-24 10:39:21.743840","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.720076","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:21.720076","last_peered":"2024-03-24 10:39:21.720076","last_clean":"2024-03-24 10:39:21.720076","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:21.720076","last_undegraded":"2024-03-24 10:39:21.720076","last_fullsized":"2024-03-24 10:39:21.720076","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722676","last_change":"2024-03-24 10:39:21.410670","last_active":"2024-03-24 10:39:21.722676","last_peered":"2024-03-24 10:39:21.722676","last_clean":"2024-03-24 10:39:21.722676","last_became_active":"2024-03-24 10:39:21.410239","last_became_peered":"2024-03-24 10:39:21.410239","last_unstale":"2024-03-24 10:39:21.722676","last_undegraded":"2024-03-24 10:39:21.722676","last_fullsized":"2024-03-24 10:39:21.722676","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744919","last_change":"2024-03-24 10:39:21.734952","last_active":"2024-03-24 10:39:21.744919","last_peered":"2024-03-24 10:39:21.744919","last_clean":"2024-03-24 10:39:21.744919","last_became_active":"2024-03-24 10:39:21.734666","last_became_peered":"2024-03-24 10:39:21.734666","last_unstale":"2024-03-24 10:39:21.744919","last_undegraded":"2024-03-24 10:39:21.744919","last_fullsized":"2024-03-24 10:39:21.744919","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724151","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:21.724151","last_peered":"2024-03-24 10:39:21.724151","last_clean":"2024-03-24 10:39:21.724151","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:21.724151","last_undegraded":"2024-03-24 10:39:21.724151","last_fullsized":"2024-03-24 10:39:21.724151","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722647","last_change":"2024-03-24 10:39:21.406436","last_active":"2024-03-24 10:39:21.722647","last_peered":"2024-03-24 10:39:21.722647","last_clean":"2024-03-24 10:39:21.722647","last_became_active":"2024-03-24 10:39:21.406101","last_became_peered":"2024-03-24 10:39:21.406101","last_unstale":"2024-03-24 10:39:21.722647","last_undegraded":"2024-03-24 10:39:21.722647","last_fullsized":"2024-03-24 10:39:21.722647","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737910","last_change":"2024-03-24 10:39:21.731561","last_active":"2024-03-24 10:39:21.737910","last_peered":"2024-03-24 10:39:21.737910","last_clean":"2024-03-24 10:39:21.737910","last_became_active":"2024-03-24 10:39:21.730998","last_became_peered":"2024-03-24 10:39:21.730998","last_unstale":"2024-03-24 10:39:21.737910","last_undegraded":"2024-03-24 10:39:21.737910","last_fullsized":"2024-03-24 10:39:21.737910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.727104","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:21.727104","last_peered":"2024-03-24 10:39:21.727104","last_clean":"2024-03-24 10:39:21.727104","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:21.727104","last_undegraded":"2024-03-24 10:39:21.727104","last_fullsized":"2024-03-24 10:39:21.727104","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726454","last_change":"2024-03-24 10:39:21.407528","last_active":"2024-03-24 10:39:21.726454","last_peered":"2024-03-24 10:39:21.726454","last_clean":"2024-03-24 10:39:21.726454","last_became_active":"2024-03-24 10:39:21.407090","last_became_peered":"2024-03-24 10:39:21.407090","last_unstale":"2024-03-24 10:39:21.726454","last_undegraded":"2024-03-24 10:39:21.726454","last_fullsized":"2024-03-24 10:39:21.726454","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745252","last_change":"2024-03-24 10:39:21.737964","last_active":"2024-03-24 10:39:21.745252","last_peered":"2024-03-24 10:39:21.745252","last_clean":"2024-03-24 10:39:21.745252","last_became_active":"2024-03-24 10:39:21.736699","last_became_peered":"2024-03-24 10:39:21.736699","last_unstale":"2024-03-24 10:39:21.745252","last_undegraded":"2024-03-24 10:39:21.745252","last_fullsized":"2024-03-24 10:39:21.745252","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724662","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:21.724662","last_peered":"2024-03-24 10:39:21.724662","last_clean":"2024-03-24 10:39:21.724662","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:21.724662","last_undegraded":"2024-03-24 10:39:21.724662","last_fullsized":"2024-03-24 10:39:21.724662","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723118","last_change":"2024-03-24 10:39:21.402542","last_active":"2024-03-24 10:39:21.723118","last_peered":"2024-03-24 10:39:21.723118","last_clean":"2024-03-24 10:39:21.723118","last_became_active":"2024-03-24 10:39:21.402228","last_became_peered":"2024-03-24 10:39:21.402228","last_unstale":"2024-03-24 10:39:21.723118","last_undegraded":"2024-03-24 10:39:21.723118","last_fullsized":"2024-03-24 10:39:21.723118","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738540","last_change":"2024-03-24 10:39:21.730414","last_active":"2024-03-24 10:39:21.738540","last_peered":"2024-03-24 10:39:21.738540","last_clean":"2024-03-24 10:39:21.738540","last_became_active":"2024-03-24 10:39:21.730157","last_became_peered":"2024-03-24 10:39:21.730157","last_unstale":"2024-03-24 10:39:21.738540","last_undegraded":"2024-03-24 10:39:21.738540","last_fullsized":"2024-03-24 10:39:21.738540","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756740","last_change":"2024-03-24 10:39:21.753593","last_active":"2024-03-24 10:39:21.756740","last_peered":"2024-03-24 10:39:21.756740","last_clean":"2024-03-24 10:39:21.756740","last_became_active":"2024-03-24 10:39:21.753209","last_became_peered":"2024-03-24 10:39:21.753209","last_unstale":"2024-03-24 10:39:21.756740","last_undegraded":"2024-03-24 10:39:21.756740","last_fullsized":"2024-03-24 10:39:21.756740","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729205","last_change":"2024-03-24 10:39:21.403995","last_active":"2024-03-24 10:39:21.729205","last_peered":"2024-03-24 10:39:21.729205","last_clean":"2024-03-24 10:39:21.729205","last_became_active":"2024-03-24 10:39:21.403652","last_became_peered":"2024-03-24 10:39:21.403652","last_unstale":"2024-03-24 10:39:21.729205","last_undegraded":"2024-03-24 10:39:21.729205","last_fullsized":"2024-03-24 10:39:21.729205","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745272","last_change":"2024-03-24 10:39:21.738871","last_active":"2024-03-24 10:39:21.745272","last_peered":"2024-03-24 10:39:21.745272","last_clean":"2024-03-24 10:39:21.745272","last_became_active":"2024-03-24 10:39:21.738567","last_became_peered":"2024-03-24 10:39:21.738567","last_unstale":"2024-03-24 10:39:21.745272","last_undegraded":"2024-03-24 10:39:21.745272","last_fullsized":"2024-03-24 10:39:21.745272","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748037","last_change":"2024-03-24 10:39:21.402898","last_active":"2024-03-24 10:39:21.748037","last_peered":"2024-03-24 10:39:21.748037","last_clean":"2024-03-24 10:39:21.748037","last_became_active":"2024-03-24 10:39:21.402655","last_became_peered":"2024-03-24 10:39:21.402655","last_unstale":"2024-03-24 10:39:21.748037","last_undegraded":"2024-03-24 10:39:21.748037","last_fullsized":"2024-03-24 10:39:21.748037","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747775","last_change":"2024-03-24 10:39:21.741510","last_active":"2024-03-24 10:39:21.747775","last_peered":"2024-03-24 10:39:21.747775","last_clean":"2024-03-24 10:39:21.747775","last_became_active":"2024-03-24 10:39:21.740907","last_became_peered":"2024-03-24 10:39:21.740907","last_unstale":"2024-03-24 10:39:21.747775","last_undegraded":"2024-03-24 10:39:21.747775","last_fullsized":"2024-03-24 10:39:21.747775","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752967","last_change":"2024-03-24 10:39:21.406729","last_active":"2024-03-24 10:39:21.752967","last_peered":"2024-03-24 10:39:21.752967","last_clean":"2024-03-24 10:39:21.752967","last_became_active":"2024-03-24 10:39:21.406428","last_became_peered":"2024-03-24 10:39:21.406428","last_unstale":"2024-03-24 10:39:21.752967","last_undegraded":"2024-03-24 10:39:21.752967","last_fullsized":"2024-03-24 10:39:21.752967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751571","last_change":"2024-03-24 10:39:21.750478","last_active":"2024-03-24 10:39:21.751571","last_peered":"2024-03-24 10:39:21.751571","last_clean":"2024-03-24 10:39:21.751571","last_became_active":"2024-03-24 10:39:21.750180","last_became_peered":"2024-03-24 10:39:21.750180","last_unstale":"2024-03-24 10:39:21.751571","last_undegraded":"2024-03-24 10:39:21.751571","last_fullsized":"2024-03-24 10:39:21.751571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.753802","last_change":"2024-03-24 10:39:21.411578","last_active":"2024-03-24 10:39:21.753802","last_peered":"2024-03-24 10:39:21.753802","last_clean":"2024-03-24 10:39:21.753802","last_became_active":"2024-03-24 10:39:21.410949","last_became_peered":"2024-03-24 10:39:21.410949","last_unstale":"2024-03-24 10:39:21.753802","last_undegraded":"2024-03-24 10:39:21.753802","last_fullsized":"2024-03-24 10:39:21.753802","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738381","last_change":"2024-03-24 10:39:21.729490","last_active":"2024-03-24 10:39:21.738381","last_peered":"2024-03-24 10:39:21.738381","last_clean":"2024-03-24 10:39:21.738381","last_became_active":"2024-03-24 10:39:21.729213","last_became_peered":"2024-03-24 10:39:21.729213","last_unstale":"2024-03-24 10:39:21.738381","last_undegraded":"2024-03-24 10:39:21.738381","last_fullsized":"2024-03-24 10:39:21.738381","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722050","last_change":"2024-03-24 10:39:21.405449","last_active":"2024-03-24 10:39:21.722050","last_peered":"2024-03-24 10:39:21.722050","last_clean":"2024-03-24 10:39:21.722050","last_became_active":"2024-03-24 10:39:21.404858","last_became_peered":"2024-03-24 10:39:21.404858","last_unstale":"2024-03-24 10:39:21.722050","last_undegraded":"2024-03-24 10:39:21.722050","last_fullsized":"2024-03-24 10:39:21.722050","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744150","last_change":"2024-03-24 10:39:21.734494","last_active":"2024-03-24 10:39:21.744150","last_peered":"2024-03-24 10:39:21.744150","last_clean":"2024-03-24 10:39:21.744150","last_became_active":"2024-03-24 10:39:21.734226","last_became_peered":"2024-03-24 10:39:21.734226","last_unstale":"2024-03-24 10:39:21.744150","last_undegraded":"2024-03-24 10:39:21.744150","last_fullsized":"2024-03-24 10:39:21.744150","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715521","last_change":"2024-03-24 10:39:21.393879","last_active":"2024-03-24 10:39:21.715521","last_peered":"2024-03-24 10:39:21.715521","last_clean":"2024-03-24 10:39:21.715521","last_became_active":"2024-03-24 10:39:21.393571","last_became_peered":"2024-03-24 10:39:21.393571","last_unstale":"2024-03-24 10:39:21.715521","last_undegraded":"2024-03-24 10:39:21.715521","last_fullsized":"2024-03-24 10:39:21.715521","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756857","last_change":"2024-03-24 10:39:21.754801","last_active":"2024-03-24 10:39:21.756857","last_peered":"2024-03-24 10:39:21.756857","last_clean":"2024-03-24 10:39:21.756857","last_became_active":"2024-03-24 10:39:21.754290","last_became_peered":"2024-03-24 10:39:21.754290","last_unstale":"2024-03-24 10:39:21.756857","last_undegraded":"2024-03-24 10:39:21.756857","last_fullsized":"2024-03-24 10:39:21.756857","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722857","last_change":"2024-03-24 10:39:21.413325","last_active":"2024-03-24 10:39:21.722857","last_peered":"2024-03-24 10:39:21.722857","last_clean":"2024-03-24 10:39:21.722857","last_became_active":"2024-03-24 10:39:21.412968","last_became_peered":"2024-03-24 10:39:21.412968","last_unstale":"2024-03-24 10:39:21.722857","last_undegraded":"2024-03-24 10:39:21.722857","last_fullsized":"2024-03-24 10:39:21.722857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750074","last_change":"2024-03-24 10:39:21.749344","last_active":"2024-03-24 10:39:21.750074","last_peered":"2024-03-24 10:39:21.750074","last_clean":"2024-03-24 10:39:21.750074","last_became_active":"2024-03-24 10:39:21.748994","last_became_peered":"2024-03-24 10:39:21.748994","last_unstale":"2024-03-24 10:39:21.750074","last_undegraded":"2024-03-24 10:39:21.750074","last_fullsized":"2024-03-24 10:39:21.750074","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723365","last_change":"2024-03-24 10:39:21.406440","last_active":"2024-03-24 10:39:21.723365","last_peered":"2024-03-24 10:39:21.723365","last_clean":"2024-03-24 10:39:21.723365","last_became_active":"2024-03-24 10:39:21.406223","last_became_peered":"2024-03-24 10:39:21.406223","last_unstale":"2024-03-24 10:39:21.723365","last_undegraded":"2024-03-24 10:39:21.723365","last_fullsized":"2024-03-24 10:39:21.723365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744941","last_change":"2024-03-24 10:39:21.735015","last_active":"2024-03-24 10:39:21.744941","last_peered":"2024-03-24 10:39:21.744941","last_clean":"2024-03-24 10:39:21.744941","last_became_active":"2024-03-24 10:39:21.734736","last_became_peered":"2024-03-24 10:39:21.734736","last_unstale":"2024-03-24 10:39:21.744941","last_undegraded":"2024-03-24 10:39:21.744941","last_fullsized":"2024-03-24 10:39:21.744941","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723220","last_change":"2024-03-24 10:39:21.402419","last_active":"2024-03-24 10:39:21.723220","last_peered":"2024-03-24 10:39:21.723220","last_clean":"2024-03-24 10:39:21.723220","last_became_active":"2024-03-24 10:39:21.402129","last_became_peered":"2024-03-24 10:39:21.402129","last_unstale":"2024-03-24 10:39:21.723220","last_undegraded":"2024-03-24 10:39:21.723220","last_fullsized":"2024-03-24 10:39:21.723220","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756584","last_change":"2024-03-24 10:39:21.752207","last_active":"2024-03-24 10:39:21.756584","last_peered":"2024-03-24 10:39:21.756584","last_clean":"2024-03-24 10:39:21.756584","last_became_active":"2024-03-24 10:39:21.751891","last_became_peered":"2024-03-24 10:39:21.751891","last_unstale":"2024-03-24 10:39:21.756584","last_undegraded":"2024-03-24 10:39:21.756584","last_fullsized":"2024-03-24 10:39:21.756584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718129","last_change":"2024-03-24 10:39:21.396998","last_active":"2024-03-24 10:39:21.718129","last_peered":"2024-03-24 10:39:21.718129","last_clean":"2024-03-24 10:39:21.718129","last_became_active":"2024-03-24 10:39:21.396640","last_became_peered":"2024-03-24 10:39:21.396640","last_unstale":"2024-03-24 10:39:21.718129","last_undegraded":"2024-03-24 10:39:21.718129","last_fullsized":"2024-03-24 10:39:21.718129","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750006","last_change":"2024-03-24 10:39:21.747974","last_active":"2024-03-24 10:39:21.750006","last_peered":"2024-03-24 10:39:21.750006","last_clean":"2024-03-24 10:39:21.750006","last_became_active":"2024-03-24 10:39:21.742188","last_became_peered":"2024-03-24 10:39:21.742188","last_unstale":"2024-03-24 10:39:21.750006","last_undegraded":"2024-03-24 10:39:21.750006","last_fullsized":"2024-03-24 10:39:21.750006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-03-24 10:39:23.028062","last_change":"2024-03-24 10:39:21.412507","last_active":"2024-03-24 10:39:23.028062","last_peered":"2024-03-24 10:39:23.028062","last_clean":"2024-03-24 10:39:23.028062","last_became_active":"2024-03-24 10:39:21.412194","last_became_peered":"2024-03-24 10:39:21.412194","last_unstale":"2024-03-24 10:39:23.028062","last_undegraded":"2024-03-24 10:39:23.028062","last_fullsized":"2024-03-24 10:39:23.028062","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755163","last_change":"2024-03-24 10:39:21.751687","last_active":"2024-03-24 10:39:21.755163","last_peered":"2024-03-24 10:39:21.755163","last_clean":"2024-03-24 10:39:21.755163","last_became_active":"2024-03-24 10:39:21.751067","last_became_peered":"2024-03-24 10:39:21.751067","last_unstale":"2024-03-24 10:39:21.755163","last_undegraded":"2024-03-24 10:39:21.755163","last_fullsized":"2024-03-24 10:39:21.755163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726350","last_change":"2024-03-24 10:39:21.409431","last_active":"2024-03-24 10:39:21.726350","last_peered":"2024-03-24 10:39:21.726350","last_clean":"2024-03-24 10:39:21.726350","last_became_active":"2024-03-24 10:39:21.409077","last_became_peered":"2024-03-24 10:39:21.409077","last_unstale":"2024-03-24 10:39:21.726350","last_undegraded":"2024-03-24 10:39:21.726350","last_fullsized":"2024-03-24 10:39:21.726350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748566","last_change":"2024-03-24 10:39:21.746704","last_active":"2024-03-24 10:39:21.748566","last_peered":"2024-03-24 10:39:21.748566","last_clean":"2024-03-24 10:39:21.748566","last_became_active":"2024-03-24 10:39:21.746288","last_became_peered":"2024-03-24 10:39:21.746288","last_unstale":"2024-03-24 10:39:21.748566","last_undegraded":"2024-03-24 10:39:21.748566","last_fullsized":"2024-03-24 10:39:21.748566","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722735","last_change":"2024-03-24 10:39:21.405622","last_active":"2024-03-24 10:39:21.722735","last_peered":"2024-03-24 10:39:21.722735","last_clean":"2024-03-24 10:39:21.722735","last_became_active":"2024-03-24 10:39:21.405031","last_became_peered":"2024-03-24 10:39:21.405031","last_unstale":"2024-03-24 10:39:21.722735","last_undegraded":"2024-03-24 10:39:21.722735","last_fullsized":"2024-03-24 10:39:21.722735","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749673","last_change":"2024-03-24 10:39:21.747203","last_active":"2024-03-24 10:39:21.749673","last_peered":"2024-03-24 10:39:21.749673","last_clean":"2024-03-24 10:39:21.749673","last_became_active":"2024-03-24 10:39:21.746669","last_became_peered":"2024-03-24 10:39:21.746669","last_unstale":"2024-03-24 10:39:21.749673","last_undegraded":"2024-03-24 10:39:21.749673","last_fullsized":"2024-03-24 10:39:21.749673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722465","last_change":"2024-03-24 10:39:21.401363","last_active":"2024-03-24 10:39:21.722465","last_peered":"2024-03-24 10:39:21.722465","last_clean":"2024-03-24 10:39:21.722465","last_became_active":"2024-03-24 10:39:21.401068","last_became_peered":"2024-03-24 10:39:21.401068","last_unstale":"2024-03-24 10:39:21.722465","last_undegraded":"2024-03-24 10:39:21.722465","last_fullsized":"2024-03-24 10:39:21.722465","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737930","last_change":"2024-03-24 10:39:21.731704","last_active":"2024-03-24 10:39:21.737930","last_peered":"2024-03-24 10:39:21.737930","last_clean":"2024-03-24 10:39:21.737930","last_became_active":"2024-03-24 10:39:21.731209","last_became_peered":"2024-03-24 10:39:21.731209","last_unstale":"2024-03-24 10:39:21.737930","last_undegraded":"2024-03-24 10:39:21.737930","last_fullsized":"2024-03-24 10:39:21.737930","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725064","last_change":"2024-03-24 10:39:21.396241","last_active":"2024-03-24 10:39:21.725064","last_peered":"2024-03-24 10:39:21.725064","last_clean":"2024-03-24 10:39:21.725064","last_became_active":"2024-03-24 10:39:21.395775","last_became_peered":"2024-03-24 10:39:21.395775","last_unstale":"2024-03-24 10:39:21.725064","last_undegraded":"2024-03-24 10:39:21.725064","last_fullsized":"2024-03-24 10:39:21.725064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745178","last_change":"2024-03-24 10:39:21.738160","last_active":"2024-03-24 10:39:21.745178","last_peered":"2024-03-24 10:39:21.745178","last_clean":"2024-03-24 10:39:21.745178","last_became_active":"2024-03-24 10:39:21.737855","last_became_peered":"2024-03-24 10:39:21.737855","last_unstale":"2024-03-24 10:39:21.745178","last_undegraded":"2024-03-24 10:39:21.745178","last_fullsized":"2024-03-24 10:39:21.745178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750738","last_change":"2024-03-24 10:39:21.398871","last_active":"2024-03-24 10:39:21.750738","last_peered":"2024-03-24 10:39:21.750738","last_clean":"2024-03-24 10:39:21.750738","last_became_active":"2024-03-24 10:39:21.398558","last_became_peered":"2024-03-24 10:39:21.398558","last_unstale":"2024-03-24 10:39:21.750738","last_undegraded":"2024-03-24 10:39:21.750738","last_fullsized":"2024-03-24 10:39:21.750738","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748448","last_change":"2024-03-24 10:39:21.746721","last_active":"2024-03-24 10:39:21.748448","last_peered":"2024-03-24 10:39:21.748448","last_clean":"2024-03-24 10:39:21.748448","last_became_active":"2024-03-24 10:39:21.746369","last_became_peered":"2024-03-24 10:39:21.746369","last_unstale":"2024-03-24 10:39:21.748448","last_undegraded":"2024-03-24 10:39:21.748448","last_fullsized":"2024-03-24 10:39:21.748448","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716479","last_change":"2024-03-24 10:39:21.397102","last_active":"2024-03-24 10:39:21.716479","last_peered":"2024-03-24 10:39:21.716479","last_clean":"2024-03-24 10:39:21.716479","last_became_active":"2024-03-24 10:39:21.396712","last_became_peered":"2024-03-24 10:39:21.396712","last_unstale":"2024-03-24 10:39:21.716479","last_undegraded":"2024-03-24 10:39:21.716479","last_fullsized":"2024-03-24 10:39:21.716479","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748075","last_change":"2024-03-24 10:39:21.742483","last_active":"2024-03-24 10:39:21.748075","last_peered":"2024-03-24 10:39:21.748075","last_clean":"2024-03-24 10:39:21.748075","last_became_active":"2024-03-24 10:39:21.740541","last_became_peered":"2024-03-24 10:39:21.740541","last_unstale":"2024-03-24 10:39:21.748075","last_undegraded":"2024-03-24 10:39:21.748075","last_fullsized":"2024-03-24 10:39:21.748075","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750097","last_change":"2024-03-24 10:39:21.411702","last_active":"2024-03-24 10:39:21.750097","last_peered":"2024-03-24 10:39:21.750097","last_clean":"2024-03-24 10:39:21.750097","last_became_active":"2024-03-24 10:39:21.410083","last_became_peered":"2024-03-24 10:39:21.410083","last_unstale":"2024-03-24 10:39:21.750097","last_undegraded":"2024-03-24 10:39:21.750097","last_fullsized":"2024-03-24 10:39:21.750097","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750114","last_change":"2024-03-24 10:39:21.749409","last_active":"2024-03-24 10:39:21.750114","last_peered":"2024-03-24 10:39:21.750114","last_clean":"2024-03-24 10:39:21.750114","last_became_active":"2024-03-24 10:39:21.749109","last_became_peered":"2024-03-24 10:39:21.749109","last_unstale":"2024-03-24 10:39:21.750114","last_undegraded":"2024-03-24 10:39:21.750114","last_fullsized":"2024-03-24 10:39:21.750114","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724400","last_change":"2024-03-24 10:39:21.400428","last_active":"2024-03-24 10:39:21.724400","last_peered":"2024-03-24 10:39:21.724400","last_clean":"2024-03-24 10:39:21.724400","last_became_active":"2024-03-24 10:39:21.400131","last_became_peered":"2024-03-24 10:39:21.400131","last_unstale":"2024-03-24 10:39:21.724400","last_undegraded":"2024-03-24 10:39:21.724400","last_fullsized":"2024-03-24 10:39:21.724400","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744265","last_change":"2024-03-24 10:39:21.735779","last_active":"2024-03-24 10:39:21.744265","last_peered":"2024-03-24 10:39:21.744265","last_clean":"2024-03-24 10:39:21.744265","last_became_active":"2024-03-24 10:39:21.735484","last_became_peered":"2024-03-24 10:39:21.735484","last_unstale":"2024-03-24 10:39:21.744265","last_undegraded":"2024-03-24 10:39:21.744265","last_fullsized":"2024-03-24 10:39:21.744265","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726445","last_change":"2024-03-24 10:39:21.411540","last_active":"2024-03-24 10:39:21.726445","last_peered":"2024-03-24 10:39:21.726445","last_clean":"2024-03-24 10:39:21.726445","last_became_active":"2024-03-24 10:39:21.410761","last_became_peered":"2024-03-24 10:39:21.410761","last_unstale":"2024-03-24 10:39:21.726445","last_undegraded":"2024-03-24 10:39:21.726445","last_fullsized":"2024-03-24 10:39:21.726445","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744906","last_change":"2024-03-24 10:39:21.736699","last_active":"2024-03-24 10:39:21.744906","last_peered":"2024-03-24 10:39:21.744906","last_clean":"2024-03-24 10:39:21.744906","last_became_active":"2024-03-24 10:39:21.736384","last_became_peered":"2024-03-24 10:39:21.736384","last_unstale":"2024-03-24 10:39:21.744906","last_undegraded":"2024-03-24 10:39:21.744906","last_fullsized":"2024-03-24 10:39:21.744906","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747414","last_change":"2024-03-24 10:39:21.398063","last_active":"2024-03-24 10:39:21.747414","last_peered":"2024-03-24 10:39:21.747414","last_clean":"2024-03-24 10:39:21.747414","last_became_active":"2024-03-24 10:39:21.397278","last_became_peered":"2024-03-24 10:39:21.397278","last_unstale":"2024-03-24 10:39:21.747414","last_undegraded":"2024-03-24 10:39:21.747414","last_fullsized":"2024-03-24 10:39:21.747414","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749692","last_change":"2024-03-24 10:39:21.747336","last_active":"2024-03-24 10:39:21.749692","last_peered":"2024-03-24 10:39:21.749692","last_clean":"2024-03-24 10:39:21.749692","last_became_active":"2024-03-24 10:39:21.746919","last_became_peered":"2024-03-24 10:39:21.746919","last_unstale":"2024-03-24 10:39:21.749692","last_undegraded":"2024-03-24 10:39:21.749692","last_fullsized":"2024-03-24 10:39:21.749692","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725976","last_change":"2024-03-24 10:39:21.404083","last_active":"2024-03-24 10:39:21.725976","last_peered":"2024-03-24 10:39:21.725976","last_clean":"2024-03-24 10:39:21.725976","last_became_active":"2024-03-24 10:39:21.403747","last_became_peered":"2024-03-24 10:39:21.403747","last_unstale":"2024-03-24 10:39:21.725976","last_undegraded":"2024-03-24 10:39:21.725976","last_fullsized":"2024-03-24 10:39:21.725976","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750584","last_change":"2024-03-24 10:39:21.749778","last_active":"2024-03-24 10:39:21.750584","last_peered":"2024-03-24 10:39:21.750584","last_clean":"2024-03-24 10:39:21.750584","last_became_active":"2024-03-24 10:39:21.749344","last_became_peered":"2024-03-24 10:39:21.749344","last_unstale":"2024-03-24 10:39:21.750584","last_undegraded":"2024-03-24 10:39:21.750584","last_fullsized":"2024-03-24 10:39:21.750584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715463","last_change":"2024-03-24 10:39:21.394117","last_active":"2024-03-24 10:39:21.715463","last_peered":"2024-03-24 10:39:21.715463","last_clean":"2024-03-24 10:39:21.715463","last_became_active":"2024-03-24 10:39:21.390303","last_became_peered":"2024-03-24 10:39:21.390303","last_unstale":"2024-03-24 10:39:21.715463","last_undegraded":"2024-03-24 10:39:21.715463","last_fullsized":"2024-03-24 10:39:21.715463","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747294","last_change":"2024-03-24 10:39:21.738700","last_active":"2024-03-24 10:39:21.747294","last_peered":"2024-03-24 10:39:21.747294","last_clean":"2024-03-24 10:39:21.747294","last_became_active":"2024-03-24 10:39:21.738406","last_became_peered":"2024-03-24 10:39:21.738406","last_unstale":"2024-03-24 10:39:21.747294","last_undegraded":"2024-03-24 10:39:21.747294","last_fullsized":"2024-03-24 10:39:21.747294","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744340","last_change":"2024-03-24 10:39:21.392998","last_active":"2024-03-24 10:39:21.744340","last_peered":"2024-03-24 10:39:21.744340","last_clean":"2024-03-24 10:39:21.744340","last_became_active":"2024-03-24 10:39:21.392663","last_became_peered":"2024-03-24 10:39:21.392663","last_unstale":"2024-03-24 10:39:21.744340","last_undegraded":"2024-03-24 10:39:21.744340","last_fullsized":"2024-03-24 10:39:21.744340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749623","last_change":"2024-03-24 10:39:21.748045","last_active":"2024-03-24 10:39:21.749623","last_peered":"2024-03-24 10:39:21.749623","last_clean":"2024-03-24 10:39:21.749623","last_became_active":"2024-03-24 10:39:21.747686","last_became_peered":"2024-03-24 10:39:21.747686","last_unstale":"2024-03-24 10:39:21.749623","last_undegraded":"2024-03-24 10:39:21.749623","last_fullsized":"2024-03-24 10:39:21.749623","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756879","last_change":"2024-03-24 10:39:21.405112","last_active":"2024-03-24 10:39:21.756879","last_peered":"2024-03-24 10:39:21.756879","last_clean":"2024-03-24 10:39:21.756879","last_became_active":"2024-03-24 10:39:21.404792","last_became_peered":"2024-03-24 10:39:21.404792","last_unstale":"2024-03-24 10:39:21.756879","last_undegraded":"2024-03-24 10:39:21.756879","last_fullsized":"2024-03-24 10:39:21.756879","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748245","last_change":"2024-03-24 10:39:21.741272","last_active":"2024-03-24 10:39:21.748245","last_peered":"2024-03-24 10:39:21.748245","last_clean":"2024-03-24 10:39:21.748245","last_became_active":"2024-03-24 10:39:21.740190","last_became_peered":"2024-03-24 10:39:21.740190","last_unstale":"2024-03-24 10:39:21.748245","last_undegraded":"2024-03-24 10:39:21.748245","last_fullsized":"2024-03-24 10:39:21.748245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723769","last_change":"2024-03-24 10:39:21.407652","last_active":"2024-03-24 10:39:21.723769","last_peered":"2024-03-24 10:39:21.723769","last_clean":"2024-03-24 10:39:21.723769","last_became_active":"2024-03-24 10:39:21.407281","last_became_peered":"2024-03-24 10:39:21.407281","last_unstale":"2024-03-24 10:39:21.723769","last_undegraded":"2024-03-24 10:39:21.723769","last_fullsized":"2024-03-24 10:39:21.723769","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744581","last_change":"2024-03-24 10:39:21.734684","last_active":"2024-03-24 10:39:21.744581","last_peered":"2024-03-24 10:39:21.744581","last_clean":"2024-03-24 10:39:21.744581","last_became_active":"2024-03-24 10:39:21.734378","last_became_peered":"2024-03-24 10:39:21.734378","last_unstale":"2024-03-24 10:39:21.744581","last_undegraded":"2024-03-24 10:39:21.744581","last_fullsized":"2024-03-24 10:39:21.744581","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724208","last_change":"2024-03-24 10:39:21.400591","last_active":"2024-03-24 10:39:21.724208","last_peered":"2024-03-24 10:39:21.724208","last_clean":"2024-03-24 10:39:21.724208","last_became_active":"2024-03-24 10:39:21.400291","last_became_peered":"2024-03-24 10:39:21.400291","last_unstale":"2024-03-24 10:39:21.724208","last_undegraded":"2024-03-24 10:39:21.724208","last_fullsized":"2024-03-24 10:39:21.724208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.734103","last_change":"2024-03-24 10:39:21.728699","last_active":"2024-03-24 10:39:21.734103","last_peered":"2024-03-24 10:39:21.734103","last_clean":"2024-03-24 10:39:21.734103","last_became_active":"2024-03-24 10:39:21.728399","last_became_peered":"2024-03-24 10:39:21.728399","last_unstale":"2024-03-24 10:39:21.734103","last_undegraded":"2024-03-24 10:39:21.734103","last_fullsized":"2024-03-24 10:39:21.734103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737300","last_change":"2024-03-24 10:39:21.389698","last_active":"2024-03-24 10:39:21.737300","last_peered":"2024-03-24 10:39:21.737300","last_clean":"2024-03-24 10:39:21.737300","last_became_active":"2024-03-24 10:39:21.389371","last_became_peered":"2024-03-24 10:39:21.389371","last_unstale":"2024-03-24 10:39:21.737300","last_undegraded":"2024-03-24 10:39:21.737300","last_fullsized":"2024-03-24 10:39:21.737300","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745793","last_change":"2024-03-24 10:39:21.736640","last_active":"2024-03-24 10:39:21.745793","last_peered":"2024-03-24 10:39:21.745793","last_clean":"2024-03-24 10:39:21.745793","last_became_active":"2024-03-24 10:39:21.736337","last_became_peered":"2024-03-24 10:39:21.736337","last_unstale":"2024-03-24 10:39:21.745793","last_undegraded":"2024-03-24 10:39:21.745793","last_fullsized":"2024-03-24 10:39:21.745793","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725719","last_change":"2024-03-24 10:39:21.398253","last_active":"2024-03-24 10:39:21.725719","last_peered":"2024-03-24 10:39:21.725719","last_clean":"2024-03-24 10:39:21.725719","last_became_active":"2024-03-24 10:39:21.397537","last_became_peered":"2024-03-24 10:39:21.397537","last_unstale":"2024-03-24 10:39:21.725719","last_undegraded":"2024-03-24 10:39:21.725719","last_fullsized":"2024-03-24 10:39:21.725719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750751","last_change":"2024-03-24 10:39:21.749427","last_active":"2024-03-24 10:39:21.750751","last_peered":"2024-03-24 10:39:21.750751","last_clean":"2024-03-24 10:39:21.750751","last_became_active":"2024-03-24 10:39:21.749070","last_became_peered":"2024-03-24 10:39:21.749070","last_unstale":"2024-03-24 10:39:21.750751","last_undegraded":"2024-03-24 10:39:21.750751","last_fullsized":"2024-03-24 10:39:21.750751","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722365","last_change":"2024-03-24 10:39:21.401943","last_active":"2024-03-24 10:39:21.722365","last_peered":"2024-03-24 10:39:21.722365","last_clean":"2024-03-24 10:39:21.722365","last_became_active":"2024-03-24 10:39:21.396400","last_became_peered":"2024-03-24 10:39:21.396400","last_unstale":"2024-03-24 10:39:21.722365","last_undegraded":"2024-03-24 10:39:21.722365","last_fullsized":"2024-03-24 10:39:21.722365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737949","last_change":"2024-03-24 10:39:21.731745","last_active":"2024-03-24 10:39:21.737949","last_peered":"2024-03-24 10:39:21.737949","last_clean":"2024-03-24 10:39:21.737949","last_became_active":"2024-03-24 10:39:21.731419","last_became_peered":"2024-03-24 10:39:21.731419","last_unstale":"2024-03-24 10:39:21.737949","last_undegraded":"2024-03-24 10:39:21.737949","last_fullsized":"2024-03-24 10:39:21.737949","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750282","last_change":"2024-03-24 10:39:21.390586","last_active":"2024-03-24 10:39:21.750282","last_peered":"2024-03-24 10:39:21.750282","last_clean":"2024-03-24 10:39:21.750282","last_became_active":"2024-03-24 10:39:21.390097","last_became_peered":"2024-03-24 10:39:21.390097","last_unstale":"2024-03-24 10:39:21.750282","last_undegraded":"2024-03-24 10:39:21.750282","last_fullsized":"2024-03-24 10:39:21.750282","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744182","last_change":"2024-03-24 10:39:21.734074","last_active":"2024-03-24 10:39:21.744182","last_peered":"2024-03-24 10:39:21.744182","last_clean":"2024-03-24 10:39:21.744182","last_became_active":"2024-03-24 10:39:21.733775","last_became_peered":"2024-03-24 10:39:21.733775","last_unstale":"2024-03-24 10:39:21.744182","last_undegraded":"2024-03-24 10:39:21.744182","last_fullsized":"2024-03-24 10:39:21.744182","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.746919","last_change":"2024-03-24 10:39:21.403801","last_active":"2024-03-24 10:39:21.746919","last_peered":"2024-03-24 10:39:21.746919","last_clean":"2024-03-24 10:39:21.746919","last_became_active":"2024-03-24 10:39:21.403475","last_became_peered":"2024-03-24 10:39:21.403475","last_unstale":"2024-03-24 10:39:21.746919","last_undegraded":"2024-03-24 10:39:21.746919","last_fullsized":"2024-03-24 10:39:21.746919","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745647","last_change":"2024-03-24 10:39:21.735800","last_active":"2024-03-24 10:39:21.745647","last_peered":"2024-03-24 10:39:21.745647","last_clean":"2024-03-24 10:39:21.745647","last_became_active":"2024-03-24 10:39:21.735499","last_became_peered":"2024-03-24 10:39:21.735499","last_unstale":"2024-03-24 10:39:21.745647","last_undegraded":"2024-03-24 10:39:21.745647","last_fullsized":"2024-03-24 10:39:21.745647","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747151","last_change":"2024-03-24 10:39:21.398511","last_active":"2024-03-24 10:39:21.747151","last_peered":"2024-03-24 10:39:21.747151","last_clean":"2024-03-24 10:39:21.747151","last_became_active":"2024-03-24 10:39:21.397759","last_became_peered":"2024-03-24 10:39:21.397759","last_unstale":"2024-03-24 10:39:21.747151","last_undegraded":"2024-03-24 10:39:21.747151","last_fullsized":"2024-03-24 10:39:21.747151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.754786","last_change":"2024-03-24 10:39:21.750697","last_active":"2024-03-24 10:39:21.754786","last_peered":"2024-03-24 10:39:21.754786","last_clean":"2024-03-24 10:39:21.754786","last_became_active":"2024-03-24 10:39:21.750360","last_became_peered":"2024-03-24 10:39:21.750360","last_unstale":"2024-03-24 10:39:21.754786","last_undegraded":"2024-03-24 10:39:21.754786","last_fullsized":"2024-03-24 10:39:21.754786","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723664","last_change":"2024-03-24 10:39:21.404992","last_active":"2024-03-24 10:39:21.723664","last_peered":"2024-03-24 10:39:21.723664","last_clean":"2024-03-24 10:39:21.723664","last_became_active":"2024-03-24 10:39:21.404656","last_became_peered":"2024-03-24 10:39:21.404656","last_unstale":"2024-03-24 10:39:21.723664","last_undegraded":"2024-03-24 10:39:21.723664","last_fullsized":"2024-03-24 10:39:21.723664","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756515","last_change":"2024-03-24 10:39:21.753684","last_active":"2024-03-24 10:39:21.756515","last_peered":"2024-03-24 10:39:21.756515","last_clean":"2024-03-24 10:39:21.756515","last_became_active":"2024-03-24 10:39:21.753331","last_became_peered":"2024-03-24 10:39:21.753331","last_unstale":"2024-03-24 10:39:21.756515","last_undegraded":"2024-03-24 10:39:21.756515","last_fullsized":"2024-03-24 10:39:21.756515","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.730085","last_change":"2024-03-24 10:39:21.411354","last_active":"2024-03-24 10:39:21.730085","last_peered":"2024-03-24 10:39:21.730085","last_clean":"2024-03-24 10:39:21.730085","last_became_active":"2024-03-24 10:39:21.410898","last_became_peered":"2024-03-24 10:39:21.410898","last_unstale":"2024-03-24 10:39:21.730085","last_undegraded":"2024-03-24 10:39:21.730085","last_fullsized":"2024-03-24 10:39:21.730085","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737268","last_change":"2024-03-24 10:39:21.731852","last_active":"2024-03-24 10:39:21.737268","last_peered":"2024-03-24 10:39:21.737268","last_clean":"2024-03-24 10:39:21.737268","last_became_active":"2024-03-24 10:39:21.731546","last_became_peered":"2024-03-24 10:39:21.731546","last_unstale":"2024-03-24 10:39:21.737268","last_undegraded":"2024-03-24 10:39:21.737268","last_fullsized":"2024-03-24 10:39:21.737268","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748581","last_change":"2024-03-24 10:39:21.395928","last_active":"2024-03-24 10:39:21.748581","last_peered":"2024-03-24 10:39:21.748581","last_clean":"2024-03-24 10:39:21.748581","last_became_active":"2024-03-24 10:39:21.395582","last_became_peered":"2024-03-24 10:39:21.395582","last_unstale":"2024-03-24 10:39:21.748581","last_undegraded":"2024-03-24 10:39:21.748581","last_fullsized":"2024-03-24 10:39:21.748581","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]}]}} 2024-03-24T10:39:32.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:39:32.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 Processor -- start 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 -- start start 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f180f58a0 0x7f9f180f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 0x7f9f1810e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.490 7f9f1e2c1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f180f91b0 con 0x7f9f180f58a0 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f1e2c1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1810ee90 con 0x7f9f180f1e40 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f1e2c1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181aa5e0 con 0x7f9f180f2290 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f180f58a0 0x7f9f180f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f16885700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 0x7f9f1810e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f180f58a0 0x7f9f180f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60474/0 (socket says 172.21.15.73:60474) 2024-03-24T10:39:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60660/0 (socket says 172.21.15.73:60660) 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 -- 172.21.15.73:0/1327537806 learned_addr learned my addr 172.21.15.73:0/1327537806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 -- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 msgr2=0x7f9f1810e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 -- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 msgr2=0x7f9f1810e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 0x7f9f1810e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 -- 172.21.15.73:0/1327537806 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f181aa790 con 0x7f9f180f58a0 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17887700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f16885700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 0x7f9f1810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f17086700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f180f58a0 0x7f9f180f1810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9f180f45c0 tx=0x7f9f08009a80).ready entity=mon.0 client_cookie=fe8e0654424ee92c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f16084700 1 -- 172.21.15.73:0/1327537806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f181aa790 con 0x7f9f180f58a0 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f16084700 1 -- 172.21.15.73:0/1327537806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0800f510 con 0x7f9f180f58a0 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f16084700 1 -- 172.21.15.73:0/1327537806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f0800f6f0 con 0x7f9f180f58a0 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f1e2c1700 1 -- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f180f58a0 msgr2=0x7f9f180f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.491 7f9f1e2c1700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f180f58a0 0x7f9f180f1810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9f180f45c0 tx=0x7f9f08009a80).stop 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 -- 172.21.15.73:0/1327537806 shutdown_connections 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180f2290 0x7f9f1810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f180f58a0 0x7f9f180f1810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 --2- 172.21.15.73:0/1327537806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f180f1e40 0x7f9f1810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 -- 172.21.15.73:0/1327537806 >> 172.21.15.73:0/1327537806 conn(0x7f9f181139f0 msgr2=0x7f9f180f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 -- 172.21.15.73:0/1327537806 shutdown_connections 2024-03-24T10:39:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.492 7f9f1e2c1700 1 -- 172.21.15.73:0/1327537806 wait complete. 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.514 7f9f1e2c1700 1 Processor -- start 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 -- start start 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f181ae380 0x7f9f181b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180da540 con 0x7f9f181ae380 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180da120 con 0x7f9f181ae7d0 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f1e2c1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181b5390 con 0x7f9f180df870 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f16885700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f181ae380 0x7f9f181b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60668/0 (socket says 172.21.15.73:60668) 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17086700 1 -- 172.21.15.73:0/2780213256 learned_addr learned my addr 172.21.15.73:0/2780213256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45640/0 (socket says 172.21.15.73:45640) 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 -- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 msgr2=0x7f9f181add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 -- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f181ae380 msgr2=0x7f9f181b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f181ae380 0x7f9f181b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17887700 1 -- 172.21.15.73:0/2780213256 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f181b55c0 con 0x7f9f181ae7d0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.515 7f9f17086700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f17887700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9f1000c000 tx=0x7f9f1000eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f181b55c0 con 0x7f9f181ae7d0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000c7b0 con 0x7f9f181ae7d0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f181bbf30 con 0x7f9f181ae7d0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f1000f040 con 0x7f9f181ae7d0 2024-03-24T10:39:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f181bc310 con 0x7f9f181ae7d0 2024-03-24T10:39:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9f10022060 con 0x7f9f181ae7d0 2024-03-24T10:39:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.516 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9f10010040 con 0x7f9f181ae7d0 2024-03-24T10:39:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.517 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f180f0860 con 0x7f9f181ae7d0 2024-03-24T10:39:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.520 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9f1000c5a0 con 0x7f9f181ae7d0 2024-03-24T10:39:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.622 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f9f180da890 con 0x7f9efc0145b0 2024-03-24T10:39:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.630 7f9f14881700 1 -- 172.21.15.73:0/2780213256 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306106 (unknown 2965378022 0 249926616) 0x7f9f08006bf0 con 0x7f9efc0145b0 2024-03-24T10:39:32.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 >> v1:172.21.15.73:6816/43277 conn(0x7f9efc0145b0 legacy=0x7f9efc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 msgr2=0x7f9f181b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9f1000c000 tx=0x7f9f1000eca0).stop 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 shutdown_connections 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9f181ae7d0 0x7f9f181b4d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9f180df870 0x7f9f181add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.632 7f9f1e2c1700 1 --2- 172.21.15.73:0/2780213256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f181ae380 0x7f9f181b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.633 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 >> 172.21.15.73:0/2780213256 conn(0x7f9f180dea30 msgr2=0x7f9f180d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.633 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 shutdown_connections 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.633 7f9f1e2c1700 1 -- 172.21.15.73:0/2780213256 wait complete. 2024-03-24T10:39:32.636 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:39:32.643 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-24 10:39:31.113596","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001190"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743122","last_change":"2024-03-24 10:39:21.733062","last_active":"2024-03-24 10:39:21.743122","last_peered":"2024-03-24 10:39:21.743122","last_clean":"2024-03-24 10:39:21.743122","last_became_active":"2024-03-24 10:39:21.732749","last_became_peered":"2024-03-24 10:39:21.732749","last_unstale":"2024-03-24 10:39:21.743122","last_undegraded":"2024-03-24 10:39:21.743122","last_fullsized":"2024-03-24 10:39:21.743122","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723064","last_change":"2024-03-24 10:39:21.410484","last_active":"2024-03-24 10:39:21.723064","last_peered":"2024-03-24 10:39:21.723064","last_clean":"2024-03-24 10:39:21.723064","last_became_active":"2024-03-24 10:39:21.410014","last_became_peered":"2024-03-24 10:39:21.410014","last_unstale":"2024-03-24 10:39:21.723064","last_undegraded":"2024-03-24 10:39:21.723064","last_fullsized":"2024-03-24 10:39:21.723064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756881","last_change":"2024-03-24 10:39:21.754967","last_active":"2024-03-24 10:39:21.756881","last_peered":"2024-03-24 10:39:21.756881","last_clean":"2024-03-24 10:39:21.756881","last_became_active":"2024-03-24 10:39:21.754511","last_became_peered":"2024-03-24 10:39:21.754511","last_unstale":"2024-03-24 10:39:21.756881","last_undegraded":"2024-03-24 10:39:21.756881","last_fullsized":"2024-03-24 10:39:21.756881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722751","last_change":"2024-03-24 10:39:21.405477","last_active":"2024-03-24 10:39:21.722751","last_peered":"2024-03-24 10:39:21.722751","last_clean":"2024-03-24 10:39:21.722751","last_became_active":"2024-03-24 10:39:21.405145","last_became_peered":"2024-03-24 10:39:21.405145","last_unstale":"2024-03-24 10:39:21.722751","last_undegraded":"2024-03-24 10:39:21.722751","last_fullsized":"2024-03-24 10:39:21.722751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750731","last_change":"2024-03-24 10:39:21.749349","last_active":"2024-03-24 10:39:21.750731","last_peered":"2024-03-24 10:39:21.750731","last_clean":"2024-03-24 10:39:21.750731","last_became_active":"2024-03-24 10:39:21.749024","last_became_peered":"2024-03-24 10:39:21.749024","last_unstale":"2024-03-24 10:39:21.750731","last_undegraded":"2024-03-24 10:39:21.750731","last_fullsized":"2024-03-24 10:39:21.750731","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724246","last_change":"2024-03-24 10:39:21.405055","last_active":"2024-03-24 10:39:21.724246","last_peered":"2024-03-24 10:39:21.724246","last_clean":"2024-03-24 10:39:21.724246","last_became_active":"2024-03-24 10:39:21.404748","last_became_peered":"2024-03-24 10:39:21.404748","last_unstale":"2024-03-24 10:39:21.724246","last_undegraded":"2024-03-24 10:39:21.724246","last_fullsized":"2024-03-24 10:39:21.724246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745143","last_change":"2024-03-24 10:39:21.742175","last_active":"2024-03-24 10:39:21.745143","last_peered":"2024-03-24 10:39:21.745143","last_clean":"2024-03-24 10:39:21.745143","last_became_active":"2024-03-24 10:39:21.741904","last_became_peered":"2024-03-24 10:39:21.741904","last_unstale":"2024-03-24 10:39:21.745143","last_undegraded":"2024-03-24 10:39:21.745143","last_fullsized":"2024-03-24 10:39:21.745143","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721675","last_change":"2024-03-24 10:39:21.405185","last_active":"2024-03-24 10:39:21.721675","last_peered":"2024-03-24 10:39:21.721675","last_clean":"2024-03-24 10:39:21.721675","last_became_active":"2024-03-24 10:39:21.404576","last_became_peered":"2024-03-24 10:39:21.404576","last_unstale":"2024-03-24 10:39:21.721675","last_undegraded":"2024-03-24 10:39:21.721675","last_fullsized":"2024-03-24 10:39:21.721675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755187","last_change":"2024-03-24 10:39:21.751864","last_active":"2024-03-24 10:39:21.755187","last_peered":"2024-03-24 10:39:21.755187","last_clean":"2024-03-24 10:39:21.755187","last_became_active":"2024-03-24 10:39:21.751297","last_became_peered":"2024-03-24 10:39:21.751297","last_unstale":"2024-03-24 10:39:21.755187","last_undegraded":"2024-03-24 10:39:21.755187","last_fullsized":"2024-03-24 10:39:21.755187","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724589","last_change":"2024-03-24 10:39:21.393191","last_active":"2024-03-24 10:39:21.724589","last_peered":"2024-03-24 10:39:21.724589","last_clean":"2024-03-24 10:39:21.724589","last_became_active":"2024-03-24 10:39:21.392863","last_became_peered":"2024-03-24 10:39:21.392863","last_unstale":"2024-03-24 10:39:21.724589","last_undegraded":"2024-03-24 10:39:21.724589","last_fullsized":"2024-03-24 10:39:21.724589","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756489","last_change":"2024-03-24 10:39:21.753654","last_active":"2024-03-24 10:39:21.756489","last_peered":"2024-03-24 10:39:21.756489","last_clean":"2024-03-24 10:39:21.756489","last_became_active":"2024-03-24 10:39:21.753306","last_became_peered":"2024-03-24 10:39:21.753306","last_unstale":"2024-03-24 10:39:21.756489","last_undegraded":"2024-03-24 10:39:21.756489","last_fullsized":"2024-03-24 10:39:21.756489","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729807","last_change":"2024-03-24 10:39:21.398093","last_active":"2024-03-24 10:39:21.729807","last_peered":"2024-03-24 10:39:21.729807","last_clean":"2024-03-24 10:39:21.729807","last_became_active":"2024-03-24 10:39:21.397415","last_became_peered":"2024-03-24 10:39:21.397415","last_unstale":"2024-03-24 10:39:21.729807","last_undegraded":"2024-03-24 10:39:21.729807","last_fullsized":"2024-03-24 10:39:21.729807","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748438","last_change":"2024-03-24 10:39:21.746784","last_active":"2024-03-24 10:39:21.748438","last_peered":"2024-03-24 10:39:21.748438","last_clean":"2024-03-24 10:39:21.748438","last_became_active":"2024-03-24 10:39:21.746406","last_became_peered":"2024-03-24 10:39:21.746406","last_unstale":"2024-03-24 10:39:21.748438","last_undegraded":"2024-03-24 10:39:21.748438","last_fullsized":"2024-03-24 10:39:21.748438","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748529","last_change":"2024-03-24 10:39:21.407422","last_active":"2024-03-24 10:39:21.748529","last_peered":"2024-03-24 10:39:21.748529","last_clean":"2024-03-24 10:39:21.748529","last_became_active":"2024-03-24 10:39:21.407030","last_became_peered":"2024-03-24 10:39:21.407030","last_unstale":"2024-03-24 10:39:21.748529","last_undegraded":"2024-03-24 10:39:21.748529","last_fullsized":"2024-03-24 10:39:21.748529","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756688","last_change":"2024-03-24 10:39:21.754359","last_active":"2024-03-24 10:39:21.756688","last_peered":"2024-03-24 10:39:21.756688","last_clean":"2024-03-24 10:39:21.756688","last_became_active":"2024-03-24 10:39:21.754061","last_became_peered":"2024-03-24 10:39:21.754061","last_unstale":"2024-03-24 10:39:21.756688","last_undegraded":"2024-03-24 10:39:21.756688","last_fullsized":"2024-03-24 10:39:21.756688","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750719","last_change":"2024-03-24 10:39:21.389253","last_active":"2024-03-24 10:39:21.750719","last_peered":"2024-03-24 10:39:21.750719","last_clean":"2024-03-24 10:39:21.750719","last_became_active":"2024-03-24 10:39:21.388938","last_became_peered":"2024-03-24 10:39:21.388938","last_unstale":"2024-03-24 10:39:21.750719","last_undegraded":"2024-03-24 10:39:21.750719","last_fullsized":"2024-03-24 10:39:21.750719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748240","last_change":"2024-03-24 10:39:21.743588","last_active":"2024-03-24 10:39:21.748240","last_peered":"2024-03-24 10:39:21.748240","last_clean":"2024-03-24 10:39:21.748240","last_became_active":"2024-03-24 10:39:21.742056","last_became_peered":"2024-03-24 10:39:21.742056","last_unstale":"2024-03-24 10:39:21.748240","last_undegraded":"2024-03-24 10:39:21.748240","last_fullsized":"2024-03-24 10:39:21.748240","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755402","last_change":"2024-03-24 10:39:21.413014","last_active":"2024-03-24 10:39:21.755402","last_peered":"2024-03-24 10:39:21.755402","last_clean":"2024-03-24 10:39:21.755402","last_became_active":"2024-03-24 10:39:21.412716","last_became_peered":"2024-03-24 10:39:21.412716","last_unstale":"2024-03-24 10:39:21.755402","last_undegraded":"2024-03-24 10:39:21.755402","last_fullsized":"2024-03-24 10:39:21.755402","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756575","last_change":"2024-03-24 10:39:21.751937","last_active":"2024-03-24 10:39:21.756575","last_peered":"2024-03-24 10:39:21.756575","last_clean":"2024-03-24 10:39:21.756575","last_became_active":"2024-03-24 10:39:21.751709","last_became_peered":"2024-03-24 10:39:21.751709","last_unstale":"2024-03-24 10:39:21.756575","last_undegraded":"2024-03-24 10:39:21.756575","last_fullsized":"2024-03-24 10:39:21.756575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722537","last_change":"2024-03-24 10:39:21.409360","last_active":"2024-03-24 10:39:21.722537","last_peered":"2024-03-24 10:39:21.722537","last_clean":"2024-03-24 10:39:21.722537","last_became_active":"2024-03-24 10:39:21.409159","last_became_peered":"2024-03-24 10:39:21.409159","last_unstale":"2024-03-24 10:39:21.722537","last_undegraded":"2024-03-24 10:39:21.722537","last_fullsized":"2024-03-24 10:39:21.722537","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743861","last_change":"2024-03-24 10:39:21.733813","last_active":"2024-03-24 10:39:21.743861","last_peered":"2024-03-24 10:39:21.743861","last_clean":"2024-03-24 10:39:21.743861","last_became_active":"2024-03-24 10:39:21.733530","last_became_peered":"2024-03-24 10:39:21.733530","last_unstale":"2024-03-24 10:39:21.743861","last_undegraded":"2024-03-24 10:39:21.743861","last_fullsized":"2024-03-24 10:39:21.743861","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725758","last_change":"2024-03-24 10:39:21.412405","last_active":"2024-03-24 10:39:21.725758","last_peered":"2024-03-24 10:39:21.725758","last_clean":"2024-03-24 10:39:21.725758","last_became_active":"2024-03-24 10:39:21.412066","last_became_peered":"2024-03-24 10:39:21.412066","last_unstale":"2024-03-24 10:39:21.725758","last_undegraded":"2024-03-24 10:39:21.725758","last_fullsized":"2024-03-24 10:39:21.725758","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749646","last_change":"2024-03-24 10:39:21.746871","last_active":"2024-03-24 10:39:21.749646","last_peered":"2024-03-24 10:39:21.749646","last_clean":"2024-03-24 10:39:21.749646","last_became_active":"2024-03-24 10:39:21.746393","last_became_peered":"2024-03-24 10:39:21.746393","last_unstale":"2024-03-24 10:39:21.749646","last_undegraded":"2024-03-24 10:39:21.749646","last_fullsized":"2024-03-24 10:39:21.749646","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745363","last_change":"2024-03-24 10:39:21.386589","last_active":"2024-03-24 10:39:21.745363","last_peered":"2024-03-24 10:39:21.745363","last_clean":"2024-03-24 10:39:21.745363","last_became_active":"2024-03-24 10:39:21.386295","last_became_peered":"2024-03-24 10:39:21.386295","last_unstale":"2024-03-24 10:39:21.745363","last_undegraded":"2024-03-24 10:39:21.745363","last_fullsized":"2024-03-24 10:39:21.745363","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744247","last_change":"2024-03-24 10:39:21.733805","last_active":"2024-03-24 10:39:21.744247","last_peered":"2024-03-24 10:39:21.744247","last_clean":"2024-03-24 10:39:21.744247","last_became_active":"2024-03-24 10:39:21.733501","last_became_peered":"2024-03-24 10:39:21.733501","last_unstale":"2024-03-24 10:39:21.744247","last_undegraded":"2024-03-24 10:39:21.744247","last_fullsized":"2024-03-24 10:39:21.744247","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747691","last_change":"2024-03-24 10:39:21.398400","last_active":"2024-03-24 10:39:21.747691","last_peered":"2024-03-24 10:39:21.747691","last_clean":"2024-03-24 10:39:21.747691","last_became_active":"2024-03-24 10:39:21.397859","last_became_peered":"2024-03-24 10:39:21.397859","last_unstale":"2024-03-24 10:39:21.747691","last_undegraded":"2024-03-24 10:39:21.747691","last_fullsized":"2024-03-24 10:39:21.747691","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747817","last_change":"2024-03-24 10:39:21.741686","last_active":"2024-03-24 10:39:21.747817","last_peered":"2024-03-24 10:39:21.747817","last_clean":"2024-03-24 10:39:21.747817","last_became_active":"2024-03-24 10:39:21.741119","last_became_peered":"2024-03-24 10:39:21.741119","last_unstale":"2024-03-24 10:39:21.747817","last_undegraded":"2024-03-24 10:39:21.747817","last_fullsized":"2024-03-24 10:39:21.747817","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752068","last_change":"2024-03-24 10:39:21.389678","last_active":"2024-03-24 10:39:21.752068","last_peered":"2024-03-24 10:39:21.752068","last_clean":"2024-03-24 10:39:21.752068","last_became_active":"2024-03-24 10:39:21.389377","last_became_peered":"2024-03-24 10:39:21.389377","last_unstale":"2024-03-24 10:39:21.752068","last_undegraded":"2024-03-24 10:39:21.752068","last_fullsized":"2024-03-24 10:39:21.752068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748099","last_change":"2024-03-24 10:39:21.742841","last_active":"2024-03-24 10:39:21.748099","last_peered":"2024-03-24 10:39:21.748099","last_clean":"2024-03-24 10:39:21.748099","last_became_active":"2024-03-24 10:39:21.742567","last_became_peered":"2024-03-24 10:39:21.742567","last_unstale":"2024-03-24 10:39:21.748099","last_undegraded":"2024-03-24 10:39:21.748099","last_fullsized":"2024-03-24 10:39:21.748099","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722471","last_change":"2024-03-24 10:39:21.407601","last_active":"2024-03-24 10:39:21.722471","last_peered":"2024-03-24 10:39:21.722471","last_clean":"2024-03-24 10:39:21.722471","last_became_active":"2024-03-24 10:39:21.407123","last_became_peered":"2024-03-24 10:39:21.407123","last_unstale":"2024-03-24 10:39:21.722471","last_undegraded":"2024-03-24 10:39:21.722471","last_fullsized":"2024-03-24 10:39:21.722471","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747918","last_change":"2024-03-24 10:39:21.741427","last_active":"2024-03-24 10:39:21.747918","last_peered":"2024-03-24 10:39:21.747918","last_clean":"2024-03-24 10:39:21.747918","last_became_active":"2024-03-24 10:39:21.741202","last_became_peered":"2024-03-24 10:39:21.741202","last_unstale":"2024-03-24 10:39:21.747918","last_undegraded":"2024-03-24 10:39:21.747918","last_fullsized":"2024-03-24 10:39:21.747918","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716544","last_change":"2024-03-24 10:39:21.397164","last_active":"2024-03-24 10:39:21.716544","last_peered":"2024-03-24 10:39:21.716544","last_clean":"2024-03-24 10:39:21.716544","last_became_active":"2024-03-24 10:39:21.396867","last_became_peered":"2024-03-24 10:39:21.396867","last_unstale":"2024-03-24 10:39:21.716544","last_undegraded":"2024-03-24 10:39:21.716544","last_fullsized":"2024-03-24 10:39:21.716544","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747260","last_change":"2024-03-24 10:39:21.740995","last_active":"2024-03-24 10:39:21.747260","last_peered":"2024-03-24 10:39:21.747260","last_clean":"2024-03-24 10:39:21.747260","last_became_active":"2024-03-24 10:39:21.740697","last_became_peered":"2024-03-24 10:39:21.740697","last_unstale":"2024-03-24 10:39:21.747260","last_undegraded":"2024-03-24 10:39:21.747260","last_fullsized":"2024-03-24 10:39:21.747260","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749980","last_change":"2024-03-24 10:39:21.411252","last_active":"2024-03-24 10:39:21.749980","last_peered":"2024-03-24 10:39:21.749980","last_clean":"2024-03-24 10:39:21.749980","last_became_active":"2024-03-24 10:39:21.410965","last_became_peered":"2024-03-24 10:39:21.410965","last_unstale":"2024-03-24 10:39:21.749980","last_undegraded":"2024-03-24 10:39:21.749980","last_fullsized":"2024-03-24 10:39:21.749980","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750603","last_change":"2024-03-24 10:39:21.749883","last_active":"2024-03-24 10:39:21.750603","last_peered":"2024-03-24 10:39:21.750603","last_clean":"2024-03-24 10:39:21.750603","last_became_active":"2024-03-24 10:39:21.749521","last_became_peered":"2024-03-24 10:39:21.749521","last_unstale":"2024-03-24 10:39:21.750603","last_undegraded":"2024-03-24 10:39:21.750603","last_fullsized":"2024-03-24 10:39:21.750603","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725159","last_change":"2024-03-24 10:39:21.396016","last_active":"2024-03-24 10:39:21.725159","last_peered":"2024-03-24 10:39:21.725159","last_clean":"2024-03-24 10:39:21.725159","last_became_active":"2024-03-24 10:39:21.395496","last_became_peered":"2024-03-24 10:39:21.395496","last_unstale":"2024-03-24 10:39:21.725159","last_undegraded":"2024-03-24 10:39:21.725159","last_fullsized":"2024-03-24 10:39:21.725159","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748341","last_change":"2024-03-24 10:39:21.741529","last_active":"2024-03-24 10:39:21.748341","last_peered":"2024-03-24 10:39:21.748341","last_clean":"2024-03-24 10:39:21.748341","last_became_active":"2024-03-24 10:39:21.741235","last_became_peered":"2024-03-24 10:39:21.741235","last_unstale":"2024-03-24 10:39:21.748341","last_undegraded":"2024-03-24 10:39:21.748341","last_fullsized":"2024-03-24 10:39:21.748341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.719089","last_change":"2024-03-24 10:39:21.401865","last_active":"2024-03-24 10:39:21.719089","last_peered":"2024-03-24 10:39:21.719089","last_clean":"2024-03-24 10:39:21.719089","last_became_active":"2024-03-24 10:39:21.401590","last_became_peered":"2024-03-24 10:39:21.401590","last_unstale":"2024-03-24 10:39:21.719089","last_undegraded":"2024-03-24 10:39:21.719089","last_fullsized":"2024-03-24 10:39:21.719089","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749696","last_change":"2024-03-24 10:39:21.747518","last_active":"2024-03-24 10:39:21.749696","last_peered":"2024-03-24 10:39:21.749696","last_clean":"2024-03-24 10:39:21.749696","last_became_active":"2024-03-24 10:39:21.746543","last_became_peered":"2024-03-24 10:39:21.746543","last_unstale":"2024-03-24 10:39:21.749696","last_undegraded":"2024-03-24 10:39:21.749696","last_fullsized":"2024-03-24 10:39:21.749696","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723834","last_change":"2024-03-24 10:39:21.398690","last_active":"2024-03-24 10:39:21.723834","last_peered":"2024-03-24 10:39:21.723834","last_clean":"2024-03-24 10:39:21.723834","last_became_active":"2024-03-24 10:39:21.398369","last_became_peered":"2024-03-24 10:39:21.398369","last_unstale":"2024-03-24 10:39:21.723834","last_undegraded":"2024-03-24 10:39:21.723834","last_fullsized":"2024-03-24 10:39:21.723834","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748298","last_change":"2024-03-24 10:39:21.745829","last_active":"2024-03-24 10:39:21.748298","last_peered":"2024-03-24 10:39:21.748298","last_clean":"2024-03-24 10:39:21.748298","last_became_active":"2024-03-24 10:39:21.745472","last_became_peered":"2024-03-24 10:39:21.745472","last_unstale":"2024-03-24 10:39:21.748298","last_undegraded":"2024-03-24 10:39:21.748298","last_fullsized":"2024-03-24 10:39:21.748298","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718093","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:21.718093","last_peered":"2024-03-24 10:39:21.718093","last_clean":"2024-03-24 10:39:21.718093","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:21.718093","last_undegraded":"2024-03-24 10:39:21.718093","last_fullsized":"2024-03-24 10:39:21.718093","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724305","last_change":"2024-03-24 10:39:21.400473","last_active":"2024-03-24 10:39:21.724305","last_peered":"2024-03-24 10:39:21.724305","last_clean":"2024-03-24 10:39:21.724305","last_became_active":"2024-03-24 10:39:21.400199","last_became_peered":"2024-03-24 10:39:21.400199","last_unstale":"2024-03-24 10:39:21.724305","last_undegraded":"2024-03-24 10:39:21.724305","last_fullsized":"2024-03-24 10:39:21.724305","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748222","last_change":"2024-03-24 10:39:21.743515","last_active":"2024-03-24 10:39:21.748222","last_peered":"2024-03-24 10:39:21.748222","last_clean":"2024-03-24 10:39:21.748222","last_became_active":"2024-03-24 10:39:21.740628","last_became_peered":"2024-03-24 10:39:21.740628","last_unstale":"2024-03-24 10:39:21.748222","last_undegraded":"2024-03-24 10:39:21.748222","last_fullsized":"2024-03-24 10:39:21.748222","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726669","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:21.726669","last_peered":"2024-03-24 10:39:21.726669","last_clean":"2024-03-24 10:39:21.726669","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:21.726669","last_undegraded":"2024-03-24 10:39:21.726669","last_fullsized":"2024-03-24 10:39:21.726669","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751900","last_change":"2024-03-24 10:39:21.410337","last_active":"2024-03-24 10:39:21.751900","last_peered":"2024-03-24 10:39:21.751900","last_clean":"2024-03-24 10:39:21.751900","last_became_active":"2024-03-24 10:39:21.410037","last_became_peered":"2024-03-24 10:39:21.410037","last_unstale":"2024-03-24 10:39:21.751900","last_undegraded":"2024-03-24 10:39:21.751900","last_fullsized":"2024-03-24 10:39:21.751900","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722808","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:39:21.722808","last_peered":"2024-03-24 10:39:21.722808","last_clean":"2024-03-24 10:39:21.722808","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:39:21.722808","last_undegraded":"2024-03-24 10:39:21.722808","last_fullsized":"2024-03-24 10:39:21.722808","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.721775","last_change":"2024-03-24 10:39:21.405373","last_active":"2024-03-24 10:39:21.721775","last_peered":"2024-03-24 10:39:21.721775","last_clean":"2024-03-24 10:39:21.721775","last_became_active":"2024-03-24 10:39:21.404592","last_became_peered":"2024-03-24 10:39:21.404592","last_unstale":"2024-03-24 10:39:21.721775","last_undegraded":"2024-03-24 10:39:21.721775","last_fullsized":"2024-03-24 10:39:21.721775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745772","last_change":"2024-03-24 10:39:21.736241","last_active":"2024-03-24 10:39:21.745772","last_peered":"2024-03-24 10:39:21.745772","last_clean":"2024-03-24 10:39:21.745772","last_became_active":"2024-03-24 10:39:21.732484","last_became_peered":"2024-03-24 10:39:21.732484","last_unstale":"2024-03-24 10:39:21.745772","last_undegraded":"2024-03-24 10:39:21.745772","last_fullsized":"2024-03-24 10:39:21.745772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726569","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:39:21.726569","last_peered":"2024-03-24 10:39:21.726569","last_clean":"2024-03-24 10:39:21.726569","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:39:21.726569","last_undegraded":"2024-03-24 10:39:21.726569","last_fullsized":"2024-03-24 10:39:21.726569","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715418","last_change":"2024-03-24 10:39:21.386180","last_active":"2024-03-24 10:39:21.715418","last_peered":"2024-03-24 10:39:21.715418","last_clean":"2024-03-24 10:39:21.715418","last_became_active":"2024-03-24 10:39:21.385860","last_became_peered":"2024-03-24 10:39:21.385860","last_unstale":"2024-03-24 10:39:21.715418","last_undegraded":"2024-03-24 10:39:21.715418","last_fullsized":"2024-03-24 10:39:21.715418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.743840","last_change":"2024-03-24 10:39:21.733305","last_active":"2024-03-24 10:39:21.743840","last_peered":"2024-03-24 10:39:21.743840","last_clean":"2024-03-24 10:39:21.743840","last_became_active":"2024-03-24 10:39:21.732991","last_became_peered":"2024-03-24 10:39:21.732991","last_unstale":"2024-03-24 10:39:21.743840","last_undegraded":"2024-03-24 10:39:21.743840","last_fullsized":"2024-03-24 10:39:21.743840","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.720076","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:39:21.720076","last_peered":"2024-03-24 10:39:21.720076","last_clean":"2024-03-24 10:39:21.720076","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:39:21.720076","last_undegraded":"2024-03-24 10:39:21.720076","last_fullsized":"2024-03-24 10:39:21.720076","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722676","last_change":"2024-03-24 10:39:21.410670","last_active":"2024-03-24 10:39:21.722676","last_peered":"2024-03-24 10:39:21.722676","last_clean":"2024-03-24 10:39:21.722676","last_became_active":"2024-03-24 10:39:21.410239","last_became_peered":"2024-03-24 10:39:21.410239","last_unstale":"2024-03-24 10:39:21.722676","last_undegraded":"2024-03-24 10:39:21.722676","last_fullsized":"2024-03-24 10:39:21.722676","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744919","last_change":"2024-03-24 10:39:21.734952","last_active":"2024-03-24 10:39:21.744919","last_peered":"2024-03-24 10:39:21.744919","last_clean":"2024-03-24 10:39:21.744919","last_became_active":"2024-03-24 10:39:21.734666","last_became_peered":"2024-03-24 10:39:21.734666","last_unstale":"2024-03-24 10:39:21.744919","last_undegraded":"2024-03-24 10:39:21.744919","last_fullsized":"2024-03-24 10:39:21.744919","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724151","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:21.724151","last_peered":"2024-03-24 10:39:21.724151","last_clean":"2024-03-24 10:39:21.724151","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:21.724151","last_undegraded":"2024-03-24 10:39:21.724151","last_fullsized":"2024-03-24 10:39:21.724151","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722647","last_change":"2024-03-24 10:39:21.406436","last_active":"2024-03-24 10:39:21.722647","last_peered":"2024-03-24 10:39:21.722647","last_clean":"2024-03-24 10:39:21.722647","last_became_active":"2024-03-24 10:39:21.406101","last_became_peered":"2024-03-24 10:39:21.406101","last_unstale":"2024-03-24 10:39:21.722647","last_undegraded":"2024-03-24 10:39:21.722647","last_fullsized":"2024-03-24 10:39:21.722647","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737910","last_change":"2024-03-24 10:39:21.731561","last_active":"2024-03-24 10:39:21.737910","last_peered":"2024-03-24 10:39:21.737910","last_clean":"2024-03-24 10:39:21.737910","last_became_active":"2024-03-24 10:39:21.730998","last_became_peered":"2024-03-24 10:39:21.730998","last_unstale":"2024-03-24 10:39:21.737910","last_undegraded":"2024-03-24 10:39:21.737910","last_fullsized":"2024-03-24 10:39:21.737910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.727104","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:21.727104","last_peered":"2024-03-24 10:39:21.727104","last_clean":"2024-03-24 10:39:21.727104","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:21.727104","last_undegraded":"2024-03-24 10:39:21.727104","last_fullsized":"2024-03-24 10:39:21.727104","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726454","last_change":"2024-03-24 10:39:21.407528","last_active":"2024-03-24 10:39:21.726454","last_peered":"2024-03-24 10:39:21.726454","last_clean":"2024-03-24 10:39:21.726454","last_became_active":"2024-03-24 10:39:21.407090","last_became_peered":"2024-03-24 10:39:21.407090","last_unstale":"2024-03-24 10:39:21.726454","last_undegraded":"2024-03-24 10:39:21.726454","last_fullsized":"2024-03-24 10:39:21.726454","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745252","last_change":"2024-03-24 10:39:21.737964","last_active":"2024-03-24 10:39:21.745252","last_peered":"2024-03-24 10:39:21.745252","last_clean":"2024-03-24 10:39:21.745252","last_became_active":"2024-03-24 10:39:21.736699","last_became_peered":"2024-03-24 10:39:21.736699","last_unstale":"2024-03-24 10:39:21.745252","last_undegraded":"2024-03-24 10:39:21.745252","last_fullsized":"2024-03-24 10:39:21.745252","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724662","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:39:21.724662","last_peered":"2024-03-24 10:39:21.724662","last_clean":"2024-03-24 10:39:21.724662","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:39:21.724662","last_undegraded":"2024-03-24 10:39:21.724662","last_fullsized":"2024-03-24 10:39:21.724662","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723118","last_change":"2024-03-24 10:39:21.402542","last_active":"2024-03-24 10:39:21.723118","last_peered":"2024-03-24 10:39:21.723118","last_clean":"2024-03-24 10:39:21.723118","last_became_active":"2024-03-24 10:39:21.402228","last_became_peered":"2024-03-24 10:39:21.402228","last_unstale":"2024-03-24 10:39:21.723118","last_undegraded":"2024-03-24 10:39:21.723118","last_fullsized":"2024-03-24 10:39:21.723118","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738540","last_change":"2024-03-24 10:39:21.730414","last_active":"2024-03-24 10:39:21.738540","last_peered":"2024-03-24 10:39:21.738540","last_clean":"2024-03-24 10:39:21.738540","last_became_active":"2024-03-24 10:39:21.730157","last_became_peered":"2024-03-24 10:39:21.730157","last_unstale":"2024-03-24 10:39:21.738540","last_undegraded":"2024-03-24 10:39:21.738540","last_fullsized":"2024-03-24 10:39:21.738540","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756740","last_change":"2024-03-24 10:39:21.753593","last_active":"2024-03-24 10:39:21.756740","last_peered":"2024-03-24 10:39:21.756740","last_clean":"2024-03-24 10:39:21.756740","last_became_active":"2024-03-24 10:39:21.753209","last_became_peered":"2024-03-24 10:39:21.753209","last_unstale":"2024-03-24 10:39:21.756740","last_undegraded":"2024-03-24 10:39:21.756740","last_fullsized":"2024-03-24 10:39:21.756740","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.729205","last_change":"2024-03-24 10:39:21.403995","last_active":"2024-03-24 10:39:21.729205","last_peered":"2024-03-24 10:39:21.729205","last_clean":"2024-03-24 10:39:21.729205","last_became_active":"2024-03-24 10:39:21.403652","last_became_peered":"2024-03-24 10:39:21.403652","last_unstale":"2024-03-24 10:39:21.729205","last_undegraded":"2024-03-24 10:39:21.729205","last_fullsized":"2024-03-24 10:39:21.729205","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745272","last_change":"2024-03-24 10:39:21.738871","last_active":"2024-03-24 10:39:21.745272","last_peered":"2024-03-24 10:39:21.745272","last_clean":"2024-03-24 10:39:21.745272","last_became_active":"2024-03-24 10:39:21.738567","last_became_peered":"2024-03-24 10:39:21.738567","last_unstale":"2024-03-24 10:39:21.745272","last_undegraded":"2024-03-24 10:39:21.745272","last_fullsized":"2024-03-24 10:39:21.745272","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748037","last_change":"2024-03-24 10:39:21.402898","last_active":"2024-03-24 10:39:21.748037","last_peered":"2024-03-24 10:39:21.748037","last_clean":"2024-03-24 10:39:21.748037","last_became_active":"2024-03-24 10:39:21.402655","last_became_peered":"2024-03-24 10:39:21.402655","last_unstale":"2024-03-24 10:39:21.748037","last_undegraded":"2024-03-24 10:39:21.748037","last_fullsized":"2024-03-24 10:39:21.748037","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747775","last_change":"2024-03-24 10:39:21.741510","last_active":"2024-03-24 10:39:21.747775","last_peered":"2024-03-24 10:39:21.747775","last_clean":"2024-03-24 10:39:21.747775","last_became_active":"2024-03-24 10:39:21.740907","last_became_peered":"2024-03-24 10:39:21.740907","last_unstale":"2024-03-24 10:39:21.747775","last_undegraded":"2024-03-24 10:39:21.747775","last_fullsized":"2024-03-24 10:39:21.747775","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.752967","last_change":"2024-03-24 10:39:21.406729","last_active":"2024-03-24 10:39:21.752967","last_peered":"2024-03-24 10:39:21.752967","last_clean":"2024-03-24 10:39:21.752967","last_became_active":"2024-03-24 10:39:21.406428","last_became_peered":"2024-03-24 10:39:21.406428","last_unstale":"2024-03-24 10:39:21.752967","last_undegraded":"2024-03-24 10:39:21.752967","last_fullsized":"2024-03-24 10:39:21.752967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.751571","last_change":"2024-03-24 10:39:21.750478","last_active":"2024-03-24 10:39:21.751571","last_peered":"2024-03-24 10:39:21.751571","last_clean":"2024-03-24 10:39:21.751571","last_became_active":"2024-03-24 10:39:21.750180","last_became_peered":"2024-03-24 10:39:21.750180","last_unstale":"2024-03-24 10:39:21.751571","last_undegraded":"2024-03-24 10:39:21.751571","last_fullsized":"2024-03-24 10:39:21.751571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.753802","last_change":"2024-03-24 10:39:21.411578","last_active":"2024-03-24 10:39:21.753802","last_peered":"2024-03-24 10:39:21.753802","last_clean":"2024-03-24 10:39:21.753802","last_became_active":"2024-03-24 10:39:21.410949","last_became_peered":"2024-03-24 10:39:21.410949","last_unstale":"2024-03-24 10:39:21.753802","last_undegraded":"2024-03-24 10:39:21.753802","last_fullsized":"2024-03-24 10:39:21.753802","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.738381","last_change":"2024-03-24 10:39:21.729490","last_active":"2024-03-24 10:39:21.738381","last_peered":"2024-03-24 10:39:21.738381","last_clean":"2024-03-24 10:39:21.738381","last_became_active":"2024-03-24 10:39:21.729213","last_became_peered":"2024-03-24 10:39:21.729213","last_unstale":"2024-03-24 10:39:21.738381","last_undegraded":"2024-03-24 10:39:21.738381","last_fullsized":"2024-03-24 10:39:21.738381","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722050","last_change":"2024-03-24 10:39:21.405449","last_active":"2024-03-24 10:39:21.722050","last_peered":"2024-03-24 10:39:21.722050","last_clean":"2024-03-24 10:39:21.722050","last_became_active":"2024-03-24 10:39:21.404858","last_became_peered":"2024-03-24 10:39:21.404858","last_unstale":"2024-03-24 10:39:21.722050","last_undegraded":"2024-03-24 10:39:21.722050","last_fullsized":"2024-03-24 10:39:21.722050","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744150","last_change":"2024-03-24 10:39:21.734494","last_active":"2024-03-24 10:39:21.744150","last_peered":"2024-03-24 10:39:21.744150","last_clean":"2024-03-24 10:39:21.744150","last_became_active":"2024-03-24 10:39:21.734226","last_became_peered":"2024-03-24 10:39:21.734226","last_unstale":"2024-03-24 10:39:21.744150","last_undegraded":"2024-03-24 10:39:21.744150","last_fullsized":"2024-03-24 10:39:21.744150","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715521","last_change":"2024-03-24 10:39:21.393879","last_active":"2024-03-24 10:39:21.715521","last_peered":"2024-03-24 10:39:21.715521","last_clean":"2024-03-24 10:39:21.715521","last_became_active":"2024-03-24 10:39:21.393571","last_became_peered":"2024-03-24 10:39:21.393571","last_unstale":"2024-03-24 10:39:21.715521","last_undegraded":"2024-03-24 10:39:21.715521","last_fullsized":"2024-03-24 10:39:21.715521","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756857","last_change":"2024-03-24 10:39:21.754801","last_active":"2024-03-24 10:39:21.756857","last_peered":"2024-03-24 10:39:21.756857","last_clean":"2024-03-24 10:39:21.756857","last_became_active":"2024-03-24 10:39:21.754290","last_became_peered":"2024-03-24 10:39:21.754290","last_unstale":"2024-03-24 10:39:21.756857","last_undegraded":"2024-03-24 10:39:21.756857","last_fullsized":"2024-03-24 10:39:21.756857","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722857","last_change":"2024-03-24 10:39:21.413325","last_active":"2024-03-24 10:39:21.722857","last_peered":"2024-03-24 10:39:21.722857","last_clean":"2024-03-24 10:39:21.722857","last_became_active":"2024-03-24 10:39:21.412968","last_became_peered":"2024-03-24 10:39:21.412968","last_unstale":"2024-03-24 10:39:21.722857","last_undegraded":"2024-03-24 10:39:21.722857","last_fullsized":"2024-03-24 10:39:21.722857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750074","last_change":"2024-03-24 10:39:21.749344","last_active":"2024-03-24 10:39:21.750074","last_peered":"2024-03-24 10:39:21.750074","last_clean":"2024-03-24 10:39:21.750074","last_became_active":"2024-03-24 10:39:21.748994","last_became_peered":"2024-03-24 10:39:21.748994","last_unstale":"2024-03-24 10:39:21.750074","last_undegraded":"2024-03-24 10:39:21.750074","last_fullsized":"2024-03-24 10:39:21.750074","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723365","last_change":"2024-03-24 10:39:21.406440","last_active":"2024-03-24 10:39:21.723365","last_peered":"2024-03-24 10:39:21.723365","last_clean":"2024-03-24 10:39:21.723365","last_became_active":"2024-03-24 10:39:21.406223","last_became_peered":"2024-03-24 10:39:21.406223","last_unstale":"2024-03-24 10:39:21.723365","last_undegraded":"2024-03-24 10:39:21.723365","last_fullsized":"2024-03-24 10:39:21.723365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744941","last_change":"2024-03-24 10:39:21.735015","last_active":"2024-03-24 10:39:21.744941","last_peered":"2024-03-24 10:39:21.744941","last_clean":"2024-03-24 10:39:21.744941","last_became_active":"2024-03-24 10:39:21.734736","last_became_peered":"2024-03-24 10:39:21.734736","last_unstale":"2024-03-24 10:39:21.744941","last_undegraded":"2024-03-24 10:39:21.744941","last_fullsized":"2024-03-24 10:39:21.744941","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723220","last_change":"2024-03-24 10:39:21.402419","last_active":"2024-03-24 10:39:21.723220","last_peered":"2024-03-24 10:39:21.723220","last_clean":"2024-03-24 10:39:21.723220","last_became_active":"2024-03-24 10:39:21.402129","last_became_peered":"2024-03-24 10:39:21.402129","last_unstale":"2024-03-24 10:39:21.723220","last_undegraded":"2024-03-24 10:39:21.723220","last_fullsized":"2024-03-24 10:39:21.723220","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756584","last_change":"2024-03-24 10:39:21.752207","last_active":"2024-03-24 10:39:21.756584","last_peered":"2024-03-24 10:39:21.756584","last_clean":"2024-03-24 10:39:21.756584","last_became_active":"2024-03-24 10:39:21.751891","last_became_peered":"2024-03-24 10:39:21.751891","last_unstale":"2024-03-24 10:39:21.756584","last_undegraded":"2024-03-24 10:39:21.756584","last_fullsized":"2024-03-24 10:39:21.756584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.718129","last_change":"2024-03-24 10:39:21.396998","last_active":"2024-03-24 10:39:21.718129","last_peered":"2024-03-24 10:39:21.718129","last_clean":"2024-03-24 10:39:21.718129","last_became_active":"2024-03-24 10:39:21.396640","last_became_peered":"2024-03-24 10:39:21.396640","last_unstale":"2024-03-24 10:39:21.718129","last_undegraded":"2024-03-24 10:39:21.718129","last_fullsized":"2024-03-24 10:39:21.718129","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750006","last_change":"2024-03-24 10:39:21.747974","last_active":"2024-03-24 10:39:21.750006","last_peered":"2024-03-24 10:39:21.750006","last_clean":"2024-03-24 10:39:21.750006","last_became_active":"2024-03-24 10:39:21.742188","last_became_peered":"2024-03-24 10:39:21.742188","last_unstale":"2024-03-24 10:39:21.750006","last_undegraded":"2024-03-24 10:39:21.750006","last_fullsized":"2024-03-24 10:39:21.750006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-03-24 10:39:23.028062","last_change":"2024-03-24 10:39:21.412507","last_active":"2024-03-24 10:39:23.028062","last_peered":"2024-03-24 10:39:23.028062","last_clean":"2024-03-24 10:39:23.028062","last_became_active":"2024-03-24 10:39:21.412194","last_became_peered":"2024-03-24 10:39:21.412194","last_unstale":"2024-03-24 10:39:23.028062","last_undegraded":"2024-03-24 10:39:23.028062","last_fullsized":"2024-03-24 10:39:23.028062","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.755163","last_change":"2024-03-24 10:39:21.751687","last_active":"2024-03-24 10:39:21.755163","last_peered":"2024-03-24 10:39:21.755163","last_clean":"2024-03-24 10:39:21.755163","last_became_active":"2024-03-24 10:39:21.751067","last_became_peered":"2024-03-24 10:39:21.751067","last_unstale":"2024-03-24 10:39:21.755163","last_undegraded":"2024-03-24 10:39:21.755163","last_fullsized":"2024-03-24 10:39:21.755163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726350","last_change":"2024-03-24 10:39:21.409431","last_active":"2024-03-24 10:39:21.726350","last_peered":"2024-03-24 10:39:21.726350","last_clean":"2024-03-24 10:39:21.726350","last_became_active":"2024-03-24 10:39:21.409077","last_became_peered":"2024-03-24 10:39:21.409077","last_unstale":"2024-03-24 10:39:21.726350","last_undegraded":"2024-03-24 10:39:21.726350","last_fullsized":"2024-03-24 10:39:21.726350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748566","last_change":"2024-03-24 10:39:21.746704","last_active":"2024-03-24 10:39:21.748566","last_peered":"2024-03-24 10:39:21.748566","last_clean":"2024-03-24 10:39:21.748566","last_became_active":"2024-03-24 10:39:21.746288","last_became_peered":"2024-03-24 10:39:21.746288","last_unstale":"2024-03-24 10:39:21.748566","last_undegraded":"2024-03-24 10:39:21.748566","last_fullsized":"2024-03-24 10:39:21.748566","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722735","last_change":"2024-03-24 10:39:21.405622","last_active":"2024-03-24 10:39:21.722735","last_peered":"2024-03-24 10:39:21.722735","last_clean":"2024-03-24 10:39:21.722735","last_became_active":"2024-03-24 10:39:21.405031","last_became_peered":"2024-03-24 10:39:21.405031","last_unstale":"2024-03-24 10:39:21.722735","last_undegraded":"2024-03-24 10:39:21.722735","last_fullsized":"2024-03-24 10:39:21.722735","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749673","last_change":"2024-03-24 10:39:21.747203","last_active":"2024-03-24 10:39:21.749673","last_peered":"2024-03-24 10:39:21.749673","last_clean":"2024-03-24 10:39:21.749673","last_became_active":"2024-03-24 10:39:21.746669","last_became_peered":"2024-03-24 10:39:21.746669","last_unstale":"2024-03-24 10:39:21.749673","last_undegraded":"2024-03-24 10:39:21.749673","last_fullsized":"2024-03-24 10:39:21.749673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722465","last_change":"2024-03-24 10:39:21.401363","last_active":"2024-03-24 10:39:21.722465","last_peered":"2024-03-24 10:39:21.722465","last_clean":"2024-03-24 10:39:21.722465","last_became_active":"2024-03-24 10:39:21.401068","last_became_peered":"2024-03-24 10:39:21.401068","last_unstale":"2024-03-24 10:39:21.722465","last_undegraded":"2024-03-24 10:39:21.722465","last_fullsized":"2024-03-24 10:39:21.722465","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737930","last_change":"2024-03-24 10:39:21.731704","last_active":"2024-03-24 10:39:21.737930","last_peered":"2024-03-24 10:39:21.737930","last_clean":"2024-03-24 10:39:21.737930","last_became_active":"2024-03-24 10:39:21.731209","last_became_peered":"2024-03-24 10:39:21.731209","last_unstale":"2024-03-24 10:39:21.737930","last_undegraded":"2024-03-24 10:39:21.737930","last_fullsized":"2024-03-24 10:39:21.737930","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725064","last_change":"2024-03-24 10:39:21.396241","last_active":"2024-03-24 10:39:21.725064","last_peered":"2024-03-24 10:39:21.725064","last_clean":"2024-03-24 10:39:21.725064","last_became_active":"2024-03-24 10:39:21.395775","last_became_peered":"2024-03-24 10:39:21.395775","last_unstale":"2024-03-24 10:39:21.725064","last_undegraded":"2024-03-24 10:39:21.725064","last_fullsized":"2024-03-24 10:39:21.725064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745178","last_change":"2024-03-24 10:39:21.738160","last_active":"2024-03-24 10:39:21.745178","last_peered":"2024-03-24 10:39:21.745178","last_clean":"2024-03-24 10:39:21.745178","last_became_active":"2024-03-24 10:39:21.737855","last_became_peered":"2024-03-24 10:39:21.737855","last_unstale":"2024-03-24 10:39:21.745178","last_undegraded":"2024-03-24 10:39:21.745178","last_fullsized":"2024-03-24 10:39:21.745178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750738","last_change":"2024-03-24 10:39:21.398871","last_active":"2024-03-24 10:39:21.750738","last_peered":"2024-03-24 10:39:21.750738","last_clean":"2024-03-24 10:39:21.750738","last_became_active":"2024-03-24 10:39:21.398558","last_became_peered":"2024-03-24 10:39:21.398558","last_unstale":"2024-03-24 10:39:21.750738","last_undegraded":"2024-03-24 10:39:21.750738","last_fullsized":"2024-03-24 10:39:21.750738","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748448","last_change":"2024-03-24 10:39:21.746721","last_active":"2024-03-24 10:39:21.748448","last_peered":"2024-03-24 10:39:21.748448","last_clean":"2024-03-24 10:39:21.748448","last_became_active":"2024-03-24 10:39:21.746369","last_became_peered":"2024-03-24 10:39:21.746369","last_unstale":"2024-03-24 10:39:21.748448","last_undegraded":"2024-03-24 10:39:21.748448","last_fullsized":"2024-03-24 10:39:21.748448","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.716479","last_change":"2024-03-24 10:39:21.397102","last_active":"2024-03-24 10:39:21.716479","last_peered":"2024-03-24 10:39:21.716479","last_clean":"2024-03-24 10:39:21.716479","last_became_active":"2024-03-24 10:39:21.396712","last_became_peered":"2024-03-24 10:39:21.396712","last_unstale":"2024-03-24 10:39:21.716479","last_undegraded":"2024-03-24 10:39:21.716479","last_fullsized":"2024-03-24 10:39:21.716479","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748075","last_change":"2024-03-24 10:39:21.742483","last_active":"2024-03-24 10:39:21.748075","last_peered":"2024-03-24 10:39:21.748075","last_clean":"2024-03-24 10:39:21.748075","last_became_active":"2024-03-24 10:39:21.740541","last_became_peered":"2024-03-24 10:39:21.740541","last_unstale":"2024-03-24 10:39:21.748075","last_undegraded":"2024-03-24 10:39:21.748075","last_fullsized":"2024-03-24 10:39:21.748075","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750097","last_change":"2024-03-24 10:39:21.411702","last_active":"2024-03-24 10:39:21.750097","last_peered":"2024-03-24 10:39:21.750097","last_clean":"2024-03-24 10:39:21.750097","last_became_active":"2024-03-24 10:39:21.410083","last_became_peered":"2024-03-24 10:39:21.410083","last_unstale":"2024-03-24 10:39:21.750097","last_undegraded":"2024-03-24 10:39:21.750097","last_fullsized":"2024-03-24 10:39:21.750097","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750114","last_change":"2024-03-24 10:39:21.749409","last_active":"2024-03-24 10:39:21.750114","last_peered":"2024-03-24 10:39:21.750114","last_clean":"2024-03-24 10:39:21.750114","last_became_active":"2024-03-24 10:39:21.749109","last_became_peered":"2024-03-24 10:39:21.749109","last_unstale":"2024-03-24 10:39:21.750114","last_undegraded":"2024-03-24 10:39:21.750114","last_fullsized":"2024-03-24 10:39:21.750114","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724400","last_change":"2024-03-24 10:39:21.400428","last_active":"2024-03-24 10:39:21.724400","last_peered":"2024-03-24 10:39:21.724400","last_clean":"2024-03-24 10:39:21.724400","last_became_active":"2024-03-24 10:39:21.400131","last_became_peered":"2024-03-24 10:39:21.400131","last_unstale":"2024-03-24 10:39:21.724400","last_undegraded":"2024-03-24 10:39:21.724400","last_fullsized":"2024-03-24 10:39:21.724400","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744265","last_change":"2024-03-24 10:39:21.735779","last_active":"2024-03-24 10:39:21.744265","last_peered":"2024-03-24 10:39:21.744265","last_clean":"2024-03-24 10:39:21.744265","last_became_active":"2024-03-24 10:39:21.735484","last_became_peered":"2024-03-24 10:39:21.735484","last_unstale":"2024-03-24 10:39:21.744265","last_undegraded":"2024-03-24 10:39:21.744265","last_fullsized":"2024-03-24 10:39:21.744265","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.726445","last_change":"2024-03-24 10:39:21.411540","last_active":"2024-03-24 10:39:21.726445","last_peered":"2024-03-24 10:39:21.726445","last_clean":"2024-03-24 10:39:21.726445","last_became_active":"2024-03-24 10:39:21.410761","last_became_peered":"2024-03-24 10:39:21.410761","last_unstale":"2024-03-24 10:39:21.726445","last_undegraded":"2024-03-24 10:39:21.726445","last_fullsized":"2024-03-24 10:39:21.726445","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744906","last_change":"2024-03-24 10:39:21.736699","last_active":"2024-03-24 10:39:21.744906","last_peered":"2024-03-24 10:39:21.744906","last_clean":"2024-03-24 10:39:21.744906","last_became_active":"2024-03-24 10:39:21.736384","last_became_peered":"2024-03-24 10:39:21.736384","last_unstale":"2024-03-24 10:39:21.744906","last_undegraded":"2024-03-24 10:39:21.744906","last_fullsized":"2024-03-24 10:39:21.744906","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747414","last_change":"2024-03-24 10:39:21.398063","last_active":"2024-03-24 10:39:21.747414","last_peered":"2024-03-24 10:39:21.747414","last_clean":"2024-03-24 10:39:21.747414","last_became_active":"2024-03-24 10:39:21.397278","last_became_peered":"2024-03-24 10:39:21.397278","last_unstale":"2024-03-24 10:39:21.747414","last_undegraded":"2024-03-24 10:39:21.747414","last_fullsized":"2024-03-24 10:39:21.747414","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749692","last_change":"2024-03-24 10:39:21.747336","last_active":"2024-03-24 10:39:21.749692","last_peered":"2024-03-24 10:39:21.749692","last_clean":"2024-03-24 10:39:21.749692","last_became_active":"2024-03-24 10:39:21.746919","last_became_peered":"2024-03-24 10:39:21.746919","last_unstale":"2024-03-24 10:39:21.749692","last_undegraded":"2024-03-24 10:39:21.749692","last_fullsized":"2024-03-24 10:39:21.749692","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725976","last_change":"2024-03-24 10:39:21.404083","last_active":"2024-03-24 10:39:21.725976","last_peered":"2024-03-24 10:39:21.725976","last_clean":"2024-03-24 10:39:21.725976","last_became_active":"2024-03-24 10:39:21.403747","last_became_peered":"2024-03-24 10:39:21.403747","last_unstale":"2024-03-24 10:39:21.725976","last_undegraded":"2024-03-24 10:39:21.725976","last_fullsized":"2024-03-24 10:39:21.725976","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750584","last_change":"2024-03-24 10:39:21.749778","last_active":"2024-03-24 10:39:21.750584","last_peered":"2024-03-24 10:39:21.750584","last_clean":"2024-03-24 10:39:21.750584","last_became_active":"2024-03-24 10:39:21.749344","last_became_peered":"2024-03-24 10:39:21.749344","last_unstale":"2024-03-24 10:39:21.750584","last_undegraded":"2024-03-24 10:39:21.750584","last_fullsized":"2024-03-24 10:39:21.750584","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.715463","last_change":"2024-03-24 10:39:21.394117","last_active":"2024-03-24 10:39:21.715463","last_peered":"2024-03-24 10:39:21.715463","last_clean":"2024-03-24 10:39:21.715463","last_became_active":"2024-03-24 10:39:21.390303","last_became_peered":"2024-03-24 10:39:21.390303","last_unstale":"2024-03-24 10:39:21.715463","last_undegraded":"2024-03-24 10:39:21.715463","last_fullsized":"2024-03-24 10:39:21.715463","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747294","last_change":"2024-03-24 10:39:21.738700","last_active":"2024-03-24 10:39:21.747294","last_peered":"2024-03-24 10:39:21.747294","last_clean":"2024-03-24 10:39:21.747294","last_became_active":"2024-03-24 10:39:21.738406","last_became_peered":"2024-03-24 10:39:21.738406","last_unstale":"2024-03-24 10:39:21.747294","last_undegraded":"2024-03-24 10:39:21.747294","last_fullsized":"2024-03-24 10:39:21.747294","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744340","last_change":"2024-03-24 10:39:21.392998","last_active":"2024-03-24 10:39:21.744340","last_peered":"2024-03-24 10:39:21.744340","last_clean":"2024-03-24 10:39:21.744340","last_became_active":"2024-03-24 10:39:21.392663","last_became_peered":"2024-03-24 10:39:21.392663","last_unstale":"2024-03-24 10:39:21.744340","last_undegraded":"2024-03-24 10:39:21.744340","last_fullsized":"2024-03-24 10:39:21.744340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.749623","last_change":"2024-03-24 10:39:21.748045","last_active":"2024-03-24 10:39:21.749623","last_peered":"2024-03-24 10:39:21.749623","last_clean":"2024-03-24 10:39:21.749623","last_became_active":"2024-03-24 10:39:21.747686","last_became_peered":"2024-03-24 10:39:21.747686","last_unstale":"2024-03-24 10:39:21.749623","last_undegraded":"2024-03-24 10:39:21.749623","last_fullsized":"2024-03-24 10:39:21.749623","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756879","last_change":"2024-03-24 10:39:21.405112","last_active":"2024-03-24 10:39:21.756879","last_peered":"2024-03-24 10:39:21.756879","last_clean":"2024-03-24 10:39:21.756879","last_became_active":"2024-03-24 10:39:21.404792","last_became_peered":"2024-03-24 10:39:21.404792","last_unstale":"2024-03-24 10:39:21.756879","last_undegraded":"2024-03-24 10:39:21.756879","last_fullsized":"2024-03-24 10:39:21.756879","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748245","last_change":"2024-03-24 10:39:21.741272","last_active":"2024-03-24 10:39:21.748245","last_peered":"2024-03-24 10:39:21.748245","last_clean":"2024-03-24 10:39:21.748245","last_became_active":"2024-03-24 10:39:21.740190","last_became_peered":"2024-03-24 10:39:21.740190","last_unstale":"2024-03-24 10:39:21.748245","last_undegraded":"2024-03-24 10:39:21.748245","last_fullsized":"2024-03-24 10:39:21.748245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723769","last_change":"2024-03-24 10:39:21.407652","last_active":"2024-03-24 10:39:21.723769","last_peered":"2024-03-24 10:39:21.723769","last_clean":"2024-03-24 10:39:21.723769","last_became_active":"2024-03-24 10:39:21.407281","last_became_peered":"2024-03-24 10:39:21.407281","last_unstale":"2024-03-24 10:39:21.723769","last_undegraded":"2024-03-24 10:39:21.723769","last_fullsized":"2024-03-24 10:39:21.723769","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744581","last_change":"2024-03-24 10:39:21.734684","last_active":"2024-03-24 10:39:21.744581","last_peered":"2024-03-24 10:39:21.744581","last_clean":"2024-03-24 10:39:21.744581","last_became_active":"2024-03-24 10:39:21.734378","last_became_peered":"2024-03-24 10:39:21.734378","last_unstale":"2024-03-24 10:39:21.744581","last_undegraded":"2024-03-24 10:39:21.744581","last_fullsized":"2024-03-24 10:39:21.744581","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.724208","last_change":"2024-03-24 10:39:21.400591","last_active":"2024-03-24 10:39:21.724208","last_peered":"2024-03-24 10:39:21.724208","last_clean":"2024-03-24 10:39:21.724208","last_became_active":"2024-03-24 10:39:21.400291","last_became_peered":"2024-03-24 10:39:21.400291","last_unstale":"2024-03-24 10:39:21.724208","last_undegraded":"2024-03-24 10:39:21.724208","last_fullsized":"2024-03-24 10:39:21.724208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.734103","last_change":"2024-03-24 10:39:21.728699","last_active":"2024-03-24 10:39:21.734103","last_peered":"2024-03-24 10:39:21.734103","last_clean":"2024-03-24 10:39:21.734103","last_became_active":"2024-03-24 10:39:21.728399","last_became_peered":"2024-03-24 10:39:21.728399","last_unstale":"2024-03-24 10:39:21.734103","last_undegraded":"2024-03-24 10:39:21.734103","last_fullsized":"2024-03-24 10:39:21.734103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737300","last_change":"2024-03-24 10:39:21.389698","last_active":"2024-03-24 10:39:21.737300","last_peered":"2024-03-24 10:39:21.737300","last_clean":"2024-03-24 10:39:21.737300","last_became_active":"2024-03-24 10:39:21.389371","last_became_peered":"2024-03-24 10:39:21.389371","last_unstale":"2024-03-24 10:39:21.737300","last_undegraded":"2024-03-24 10:39:21.737300","last_fullsized":"2024-03-24 10:39:21.737300","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745793","last_change":"2024-03-24 10:39:21.736640","last_active":"2024-03-24 10:39:21.745793","last_peered":"2024-03-24 10:39:21.745793","last_clean":"2024-03-24 10:39:21.745793","last_became_active":"2024-03-24 10:39:21.736337","last_became_peered":"2024-03-24 10:39:21.736337","last_unstale":"2024-03-24 10:39:21.745793","last_undegraded":"2024-03-24 10:39:21.745793","last_fullsized":"2024-03-24 10:39:21.745793","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.725719","last_change":"2024-03-24 10:39:21.398253","last_active":"2024-03-24 10:39:21.725719","last_peered":"2024-03-24 10:39:21.725719","last_clean":"2024-03-24 10:39:21.725719","last_became_active":"2024-03-24 10:39:21.397537","last_became_peered":"2024-03-24 10:39:21.397537","last_unstale":"2024-03-24 10:39:21.725719","last_undegraded":"2024-03-24 10:39:21.725719","last_fullsized":"2024-03-24 10:39:21.725719","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750751","last_change":"2024-03-24 10:39:21.749427","last_active":"2024-03-24 10:39:21.750751","last_peered":"2024-03-24 10:39:21.750751","last_clean":"2024-03-24 10:39:21.750751","last_became_active":"2024-03-24 10:39:21.749070","last_became_peered":"2024-03-24 10:39:21.749070","last_unstale":"2024-03-24 10:39:21.750751","last_undegraded":"2024-03-24 10:39:21.750751","last_fullsized":"2024-03-24 10:39:21.750751","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.722365","last_change":"2024-03-24 10:39:21.401943","last_active":"2024-03-24 10:39:21.722365","last_peered":"2024-03-24 10:39:21.722365","last_clean":"2024-03-24 10:39:21.722365","last_became_active":"2024-03-24 10:39:21.396400","last_became_peered":"2024-03-24 10:39:21.396400","last_unstale":"2024-03-24 10:39:21.722365","last_undegraded":"2024-03-24 10:39:21.722365","last_fullsized":"2024-03-24 10:39:21.722365","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737949","last_change":"2024-03-24 10:39:21.731745","last_active":"2024-03-24 10:39:21.737949","last_peered":"2024-03-24 10:39:21.737949","last_clean":"2024-03-24 10:39:21.737949","last_became_active":"2024-03-24 10:39:21.731419","last_became_peered":"2024-03-24 10:39:21.731419","last_unstale":"2024-03-24 10:39:21.737949","last_undegraded":"2024-03-24 10:39:21.737949","last_fullsized":"2024-03-24 10:39:21.737949","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.750282","last_change":"2024-03-24 10:39:21.390586","last_active":"2024-03-24 10:39:21.750282","last_peered":"2024-03-24 10:39:21.750282","last_clean":"2024-03-24 10:39:21.750282","last_became_active":"2024-03-24 10:39:21.390097","last_became_peered":"2024-03-24 10:39:21.390097","last_unstale":"2024-03-24 10:39:21.750282","last_undegraded":"2024-03-24 10:39:21.750282","last_fullsized":"2024-03-24 10:39:21.750282","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.744182","last_change":"2024-03-24 10:39:21.734074","last_active":"2024-03-24 10:39:21.744182","last_peered":"2024-03-24 10:39:21.744182","last_clean":"2024-03-24 10:39:21.744182","last_became_active":"2024-03-24 10:39:21.733775","last_became_peered":"2024-03-24 10:39:21.733775","last_unstale":"2024-03-24 10:39:21.744182","last_undegraded":"2024-03-24 10:39:21.744182","last_fullsized":"2024-03-24 10:39:21.744182","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.746919","last_change":"2024-03-24 10:39:21.403801","last_active":"2024-03-24 10:39:21.746919","last_peered":"2024-03-24 10:39:21.746919","last_clean":"2024-03-24 10:39:21.746919","last_became_active":"2024-03-24 10:39:21.403475","last_became_peered":"2024-03-24 10:39:21.403475","last_unstale":"2024-03-24 10:39:21.746919","last_undegraded":"2024-03-24 10:39:21.746919","last_fullsized":"2024-03-24 10:39:21.746919","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.745647","last_change":"2024-03-24 10:39:21.735800","last_active":"2024-03-24 10:39:21.745647","last_peered":"2024-03-24 10:39:21.745647","last_clean":"2024-03-24 10:39:21.745647","last_became_active":"2024-03-24 10:39:21.735499","last_became_peered":"2024-03-24 10:39:21.735499","last_unstale":"2024-03-24 10:39:21.745647","last_undegraded":"2024-03-24 10:39:21.745647","last_fullsized":"2024-03-24 10:39:21.745647","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.747151","last_change":"2024-03-24 10:39:21.398511","last_active":"2024-03-24 10:39:21.747151","last_peered":"2024-03-24 10:39:21.747151","last_clean":"2024-03-24 10:39:21.747151","last_became_active":"2024-03-24 10:39:21.397759","last_became_peered":"2024-03-24 10:39:21.397759","last_unstale":"2024-03-24 10:39:21.747151","last_undegraded":"2024-03-24 10:39:21.747151","last_fullsized":"2024-03-24 10:39:21.747151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.754786","last_change":"2024-03-24 10:39:21.750697","last_active":"2024-03-24 10:39:21.754786","last_peered":"2024-03-24 10:39:21.754786","last_clean":"2024-03-24 10:39:21.754786","last_became_active":"2024-03-24 10:39:21.750360","last_became_peered":"2024-03-24 10:39:21.750360","last_unstale":"2024-03-24 10:39:21.754786","last_undegraded":"2024-03-24 10:39:21.754786","last_fullsized":"2024-03-24 10:39:21.754786","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.723664","last_change":"2024-03-24 10:39:21.404992","last_active":"2024-03-24 10:39:21.723664","last_peered":"2024-03-24 10:39:21.723664","last_clean":"2024-03-24 10:39:21.723664","last_became_active":"2024-03-24 10:39:21.404656","last_became_peered":"2024-03-24 10:39:21.404656","last_unstale":"2024-03-24 10:39:21.723664","last_undegraded":"2024-03-24 10:39:21.723664","last_fullsized":"2024-03-24 10:39:21.723664","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.756515","last_change":"2024-03-24 10:39:21.753684","last_active":"2024-03-24 10:39:21.756515","last_peered":"2024-03-24 10:39:21.756515","last_clean":"2024-03-24 10:39:21.756515","last_became_active":"2024-03-24 10:39:21.753331","last_became_peered":"2024-03-24 10:39:21.753331","last_unstale":"2024-03-24 10:39:21.756515","last_undegraded":"2024-03-24 10:39:21.756515","last_fullsized":"2024-03-24 10:39:21.756515","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.730085","last_change":"2024-03-24 10:39:21.411354","last_active":"2024-03-24 10:39:21.730085","last_peered":"2024-03-24 10:39:21.730085","last_clean":"2024-03-24 10:39:21.730085","last_became_active":"2024-03-24 10:39:21.410898","last_became_peered":"2024-03-24 10:39:21.410898","last_unstale":"2024-03-24 10:39:21.730085","last_undegraded":"2024-03-24 10:39:21.730085","last_fullsized":"2024-03-24 10:39:21.730085","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.737268","last_change":"2024-03-24 10:39:21.731852","last_active":"2024-03-24 10:39:21.737268","last_peered":"2024-03-24 10:39:21.737268","last_clean":"2024-03-24 10:39:21.737268","last_became_active":"2024-03-24 10:39:21.731546","last_became_peered":"2024-03-24 10:39:21.731546","last_unstale":"2024-03-24 10:39:21.737268","last_undegraded":"2024-03-24 10:39:21.737268","last_fullsized":"2024-03-24 10:39:21.737268","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:21.362909","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:21.362909","last_clean_scrub_stamp":"2024-03-24 10:39:21.362909","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-03-24 10:39:21.748581","last_change":"2024-03-24 10:39:21.395928","last_active":"2024-03-24 10:39:21.748581","last_peered":"2024-03-24 10:39:21.748581","last_clean":"2024-03-24 10:39:21.748581","last_became_active":"2024-03-24 10:39:21.395582","last_became_peered":"2024-03-24 10:39:21.395582","last_unstale":"2024-03-24 10:39:21.748581","last_undegraded":"2024-03-24 10:39:21.748581","last_fullsized":"2024-03-24 10:39:21.748581","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:20.350551","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:20.350551","last_clean_scrub_stamp":"2024-03-24 10:39:20.350551","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]}]}} 2024-03-24T10:39:32.648 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-24T10:39:32.648 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-24T10:39:32.648 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-24T10:39:32.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-24T10:39:32.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 Processor -- start 2024-03-24T10:39:32.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 -- start start 2024-03-24T10:39:32.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 0x7f829c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 0x7f829c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c1a0a70 con 0x7f829c10bb90 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0fa590 con 0x7f829c0f5a10 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.808 7f82a13c3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1a0c90 con 0x7f829c10b740 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829a05c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 0x7f829c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 0x7f829c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829a85d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f829c10bb90 0x7f829c1a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49404/0 (socket says 172.21.15.73:49404) 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829a85d700 1 -- 172.21.15.73:0/2864170295 learned_addr learned my addr 172.21.15.73:0/2864170295 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829905a700 1 -- 172.21.15.73:0/2864170295 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650575752 0 0) 0x7f8294001490 con 0x7f829c10bb90 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829905a700 1 -- 172.21.15.73:0/2864170295 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280003270 con 0x7f829c10bb90 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 -- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 msgr2=0x7f829c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 0x7f829c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 -- 172.21.15.73:0/2864170295 >> v1:172.21.15.73:6789/0 conn(0x7f829c10bb90 legacy=0x7f829c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 -- 172.21.15.73:0/2864170295 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c1a93d0 con 0x7f829c10b740 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829a05c700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 0x7f829c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829985b700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 0x7f829c19fc40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f829c10f920 tx=0x7f828c00b9d0).ready entity=mon.2 client_cookie=6cc12916c7de1bcd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829905a700 1 -- 172.21.15.73:0/2864170295 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f829c1a93d0 con 0x7f829c10b740 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829905a700 1 -- 172.21.15.73:0/2864170295 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00d570 con 0x7f829c10b740 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f829905a700 1 -- 172.21.15.73:0/2864170295 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f828c00d940 con 0x7f829c10b740 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f82a13c3700 1 -- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 msgr2=0x7f829c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.809 7f82a13c3700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 0x7f829c19fc40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f829c10f920 tx=0x7f828c00b9d0).stop 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 -- 172.21.15.73:0/2864170295 shutdown_connections 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c0f5a10 0x7f829c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 --2- 172.21.15.73:0/2864170295 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c10b740 0x7f829c19fc40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 -- 172.21.15.73:0/2864170295 >> 172.21.15.73:0/2864170295 conn(0x7f829c113a70 msgr2=0x7f829c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 -- 172.21.15.73:0/2864170295 shutdown_connections 2024-03-24T10:39:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.810 7f82a13c3700 1 -- 172.21.15.73:0/2864170295 wait complete. 2024-03-24T10:39:32.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 Processor -- start 2024-03-24T10:39:32.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 -- start start 2024-03-24T10:39:32.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 0x7f829c0ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 0x7f829c1b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c4ae0 con 0x7f829c0de0e0 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0f1f00 con 0x7f829c1ac010 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f82a13c3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0f2140 con 0x7f829c0dd660 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a05c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 0x7f829c0ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829985b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 0x7f829c1b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a05c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 0x7f829c0ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60688/0 (socket says 172.21.15.73:60688) 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a05c700 1 -- 172.21.15.73:0/3617883198 learned_addr learned my addr 172.21.15.73:0/3617883198 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829985b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60500/0 (socket says 172.21.15.73:60500) 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 -- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 msgr2=0x7f829c0ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 0x7f829c0ddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 -- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 msgr2=0x7f829c1ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829a85d700 1 -- 172.21.15.73:0/3617883198 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0f1ad0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.833 7f829985b700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f829a85d700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 0x7f829c1b9ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f829c0c29a0 tx=0x7f829400c980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f829c0f1ad0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294005bb0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82940048b0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c1ac460 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c1ba1d0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8294004ab0 con 0x7f829c1ac010 2024-03-24T10:39:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.834 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f829400b9b0 con 0x7f829c1ac010 2024-03-24T10:39:32.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.835 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0f08e0 con 0x7f829c1ac010 2024-03-24T10:39:32.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.838 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f82940059a0 con 0x7f829c1ac010 2024-03-24T10:39:32.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.976 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f829c0e2430 con 0x7f829c1ac010 2024-03-24T10:39:32.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.976 7f828b7fe700 1 -- 172.21.15.73:0/3617883198 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+34 (secure 0 0 0) 0x7f8294000fb0 con 0x7f829c1ac010 2024-03-24T10:39:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 >> v1:172.21.15.73:6816/43277 conn(0x7f82780145b0 legacy=0x7f8278016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 msgr2=0x7f829c1b9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 0x7f829c1b9ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f829c0c29a0 tx=0x7f829400c980).stop 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 shutdown_connections 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f829c1ac010 0x7f829c1b9ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f829c0dd660 0x7f829c0ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 --2- 172.21.15.73:0/3617883198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0de0e0 0x7f829c1ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.977 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 >> 172.21.15.73:0/3617883198 conn(0x7f829c0c6d80 msgr2=0x7f829c1a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.978 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 shutdown_connections 2024-03-24T10:39:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:32.978 7f82a13c3700 1 -- 172.21.15.73:0/3617883198 wait complete. 2024-03-24T10:39:32.989 INFO:teuthology.orchestra.run.smithi073.stdout:{"checks":{},"status":"HEALTH_OK"} 2024-03-24T10:39:32.989 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-24T10:39:32.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:33.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 Processor -- start 2024-03-24T10:39:33.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 -- start start 2024-03-24T10:39:33.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 0x7ff4c810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4c810b740 0x7ff4c819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c81a0a70 con 0x7ff4c810bb90 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80fa590 con 0x7ff4c810b740 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4cd134700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c81a0c90 con 0x7ff4c80f5a10 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4c55fb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4c810b740 0x7ff4c819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4c5dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 0x7ff4c810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4c65fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff4c810bb90 0x7ff4c81a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49408/0 (socket says 172.21.15.73:49408) 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.114 7ff4c65fd700 1 -- 172.21.15.73:0/3191441550 learned_addr learned my addr 172.21.15.73:0/3191441550 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c4dfa700 1 -- 172.21.15.73:0/3191441550 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619451263 0 0) 0x7ff4b8001110 con 0x7ff4c810bb90 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c4dfa700 1 -- 172.21.15.73:0/3191441550 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a8003270 con 0x7ff4c810bb90 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c55fb700 1 -- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 msgr2=0x7ff4c810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c55fb700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 0x7ff4c810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c55fb700 1 -- 172.21.15.73:0/3191441550 >> v1:172.21.15.73:6789/0 conn(0x7ff4c810bb90 legacy=0x7ff4c81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c55fb700 1 -- 172.21.15.73:0/3191441550 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c81a93d0 con 0x7ff4c810b740 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c5dfc700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 0x7ff4c810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c55fb700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c810b740 0x7ff4c819fc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff4b0002f70 tx=0x7ff4b000dc50).ready entity=mon.0 client_cookie=57307f3b852199bb server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c4dfa700 1 -- 172.21.15.73:0/3191441550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4c81a93d0 con 0x7ff4c810b740 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c4dfa700 1 -- 172.21.15.73:0/3191441550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000bbe0 con 0x7ff4c810b740 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4c4dfa700 1 -- 172.21.15.73:0/3191441550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4b0015070 con 0x7ff4c810b740 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4cd134700 1 -- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c810b740 msgr2=0x7ff4c819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.115 7ff4cd134700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c810b740 0x7ff4c819fc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff4b0002f70 tx=0x7ff4b000dc50).stop 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 -- 172.21.15.73:0/3191441550 shutdown_connections 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80f5a10 0x7ff4c810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 --2- 172.21.15.73:0/3191441550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c810b740 0x7ff4c819fc40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 -- 172.21.15.73:0/3191441550 >> 172.21.15.73:0/3191441550 conn(0x7ff4c8113a70 msgr2=0x7ff4c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 -- 172.21.15.73:0/3191441550 shutdown_connections 2024-03-24T10:39:33.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.116 7ff4cd134700 1 -- 172.21.15.73:0/3191441550 wait complete. 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.138 7ff4cd134700 1 Processor -- start 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.138 7ff4cd134700 1 -- start start 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 0x7ff4c80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 0x7ff4c81b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 0x7ff4c81b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80dcd60 con 0x7ff4c80cce50 2024-03-24T10:39:33.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80dc710 con 0x7ff4c80cca00 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80dca60 con 0x7ff4c80dd3c0 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c5dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 0x7ff4c80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 0x7ff4c81b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c5dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 0x7ff4c80cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60704/0 (socket says 172.21.15.73:60704) 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c5dfc700 1 -- 172.21.15.73:0/162976263 learned_addr learned my addr 172.21.15.73:0/162976263 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c55fb700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 0x7ff4c81b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 -- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 msgr2=0x7ff4c80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 0x7ff4c80cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 -- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 msgr2=0x7ff4c81b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 0x7ff4c81b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 -- 172.21.15.73:0/162976263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c81b10f0 con 0x7ff4c80cce50 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c55fb700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 0x7ff4c81b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4c65fd700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 0x7ff4c81b0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff4c80dc9d0 tx=0x7ff4b800c810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4c81b10f0 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8007110 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4b8005030 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 -- 172.21.15.73:0/162976263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c81b7c00 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.139 7ff4cd134700 1 -- 172.21.15.73:0/162976263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c81b7fe0 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.140 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff4b8005230 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.140 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff4b800b780 con 0x7ff4c80cce50 2024-03-24T10:39:33.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.140 7ff4cd134700 1 -- 172.21.15.73:0/162976263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80f08e0 con 0x7ff4c80cce50 2024-03-24T10:39:33.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.144 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff4b800cd80 con 0x7ff4c80cce50 2024-03-24T10:39:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.251 7ff4cd134700 1 -- 172.21.15.73:0/162976263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c81aabb0 con 0x7ff4c80cce50 2024-03-24T10:39:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.251 7ff4beffd700 1 -- 172.21.15.73:0/162976263 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7ff4b8000c30 con 0x7ff4c80cce50 2024-03-24T10:39:33.253 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:33.253 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 >> v1:172.21.15.73:6816/43277 conn(0x7ff4ac0145b0 legacy=0x7ff4ac016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 msgr2=0x7ff4c81b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 0x7ff4c81b0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff4c80dc9d0 tx=0x7ff4b800c810).stop 2024-03-24T10:39:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 shutdown_connections 2024-03-24T10:39:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4c80cce50 0x7ff4c81b0ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4c80dd3c0 0x7ff4c80cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 --2- 172.21.15.73:0/162976263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4c80cca00 0x7ff4c81b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 >> 172.21.15.73:0/162976263 conn(0x7ff4c80e0b40 msgr2=0x7ff4c80ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 shutdown_connections 2024-03-24T10:39:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.253 7ff4cd134700 1 -- 172.21.15.73:0/162976263 wait complete. 2024-03-24T10:39:33.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:33.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:33.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 Processor -- start 2024-03-24T10:39:33.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 -- start start 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80f26c0 con 0x7f5bd810c970 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80fa290 con 0x7f5bd810cdc0 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bdd9d6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80f95c0 con 0x7f5bd80f5920 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd65c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd6dc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd65c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60718/0 (socket says 172.21.15.73:60718) 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd5dc4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5bd810c970 0x7f5bd80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49416/0 (socket says 172.21.15.73:49416) 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd6dc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60520/0 (socket says 172.21.15.73:60520) 2024-03-24T10:39:33.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.392 7f5bd65c5700 1 -- 172.21.15.73:0/4162828517 learned_addr learned my addr 172.21.15.73:0/4162828517 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd65c5700 1 -- 172.21.15.73:0/4162828517 >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 msgr2=0x7f5bd80f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd65c5700 1 --2- 172.21.15.73:0/4162828517 >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd65c5700 1 -- 172.21.15.73:0/4162828517 >> v1:172.21.15.73:6789/0 conn(0x7f5bd810c970 legacy=0x7f5bd80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd55c3700 1 -- 172.21.15.73:0/4162828517 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169265851 0 0) 0x7f5bc8001110 con 0x7f5bd810c970 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd65c5700 1 -- 172.21.15.73:0/4162828517 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd81aa5e0 con 0x7f5bd80f5920 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd6dc6700 1 --2- 172.21.15.73:0/4162828517 >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd65c5700 1 --2- 172.21.15.73:0/4162828517 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc0099d0).ready entity=mon.2 client_cookie=ad58fc0e24b6c50c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd55c3700 1 -- 172.21.15.73:0/4162828517 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bd81aa5e0 con 0x7f5bd80f5920 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd55c3700 1 -- 172.21.15.73:0/4162828517 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc00f510 con 0x7f5bd80f5920 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bd55c3700 1 -- 172.21.15.73:0/4162828517 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bcc00f6f0 con 0x7f5bd80f5920 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bdd9d6700 1 -- 172.21.15.73:0/4162828517 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 msgr2=0x7f5bd810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.393 7f5bdd9d6700 1 --2- 172.21.15.73:0/4162828517 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5bcc002f70 tx=0x7f5bcc0099d0).stop 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 -- 172.21.15.73:0/4162828517 shutdown_connections 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 --2- 172.21.15.73:0/4162828517 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd80f5920 0x7f5bd810c340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 --2- 172.21.15.73:0/4162828517 >> v2:172.21.15.73:3300/0 conn(0x7f5bd810cdc0 0x7f5bd80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 -- 172.21.15.73:0/4162828517 >> 172.21.15.73:0/4162828517 conn(0x7f5bd8113a70 msgr2=0x7f5bd80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 -- 172.21.15.73:0/4162828517 shutdown_connections 2024-03-24T10:39:33.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.394 7f5bdd9d6700 1 -- 172.21.15.73:0/4162828517 wait complete. 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.416 7f5bdd9d6700 1 Processor -- start 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.416 7f5bdd9d6700 1 -- start start 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80d54c0 0x7f5bd80d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80de400 con 0x7f5bd80d5f40 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81b3400 con 0x7f5bd80d54c0 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80dc8e0 con 0x7f5bd81b2980 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd5dc4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60734/0 (socket says 172.21.15.73:60734) 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd5dc4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60522/0 (socket says 172.21.15.73:60522) 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 -- 172.21.15.73:0/3261595609 learned_addr learned my addr 172.21.15.73:0/3261595609 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd65c5700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80d54c0 0x7f5bd80d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 -- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80d54c0 msgr2=0x7f5bd80d5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80d54c0 0x7f5bd80d5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 -- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 msgr2=0x7f5bd81b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 -- 172.21.15.73:0/3261595609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80ceaf0 con 0x7f5bd81b2980 2024-03-24T10:39:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd5dc4700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bd6dc6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5bd81a7540 tx=0x7f5bd000ede0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bd80ceaf0 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000c900 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd81b9a40 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5bd000f040 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.417 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd81b9e20 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.418 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5bd0022060 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.418 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5bd0010040 con 0x7f5bd81b2980 2024-03-24T10:39:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.419 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd80f08e0 con 0x7f5bd81b2980 2024-03-24T10:39:33.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.422 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5bd000c6f0 con 0x7f5bd81b2980 2024-03-24T10:39:33.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.527 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bd81aca90 con 0x7f5bd81b2980 2024-03-24T10:39:33.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.527 7f5bc77fe700 1 -- 172.21.15.73:0/3261595609 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bd81145f0 con 0x7f5bd81b2980 2024-03-24T10:39:33.528 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 >> v1:172.21.15.73:6816/43277 conn(0x7f5bb40145b0 legacy=0x7f5bb4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 msgr2=0x7f5bd81b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5bd81a7540 tx=0x7f5bd000ede0).stop 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 shutdown_connections 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5bd81b2980 0x7f5bd81b2dd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bd80d54c0 0x7f5bd80d5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.528 7f5bdd9d6700 1 --2- 172.21.15.73:0/3261595609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bd80d5f40 0x7f5bd81b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.529 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 >> 172.21.15.73:0/3261595609 conn(0x7f5bd80cf9c0 msgr2=0x7f5bd81a6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.529 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 shutdown_connections 2024-03-24T10:39:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.529 7f5bdd9d6700 1 -- 172.21.15.73:0/3261595609 wait complete. 2024-03-24T10:39:33.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 Processor -- start 2024-03-24T10:39:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 -- start start 2024-03-24T10:39:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 0x7f0f5410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 0x7f0f541a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f541a0a70 con 0x7f0f5410b740 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540fa590 con 0x7f0f5410bb90 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f58ae0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541a0c90 con 0x7f0f540f5a10 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f5104f700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f5410b740 0x7f0f5419fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49420/0 (socket says 172.21.15.73:49420) 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f5104f700 1 -- 172.21.15.73:0/3798337298 learned_addr learned my addr 172.21.15.73:0/3798337298 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f52051700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 0x7f0f541a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.668 7f0f51850700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 0x7f0f5410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f5084e700 1 -- 172.21.15.73:0/3798337298 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517658788 0 0) 0x7f0f44001110 con 0x7f0f5410b740 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f5084e700 1 -- 172.21.15.73:0/3798337298 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f38003270 con 0x7f0f5410b740 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f52051700 1 -- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 msgr2=0x7f0f5410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f52051700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 0x7f0f5410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f52051700 1 -- 172.21.15.73:0/3798337298 >> v1:172.21.15.73:6789/0 conn(0x7f0f5410b740 legacy=0x7f0f5419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f52051700 1 -- 172.21.15.73:0/3798337298 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f541a93d0 con 0x7f0f5410bb90 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f51850700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 0x7f0f5410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f52051700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 0x7f0f541a0440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0f54103a10 tx=0x7f0f4c009d70).ready entity=mon.1 client_cookie=f64ff83f9f2a0fa5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f5084e700 1 -- 172.21.15.73:0/3798337298 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f541a93d0 con 0x7f0f5410bb90 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f5084e700 1 -- 172.21.15.73:0/3798337298 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b7c0 con 0x7f0f5410bb90 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f5084e700 1 -- 172.21.15.73:0/3798337298 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f4c00b9a0 con 0x7f0f5410bb90 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f58ae0700 1 -- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 msgr2=0x7f0f541a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.669 7f0f58ae0700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 0x7f0f541a0440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0f54103a10 tx=0x7f0f4c009d70).stop 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 -- 172.21.15.73:0/3798337298 shutdown_connections 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5410bb90 0x7f0f541a0440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 --2- 172.21.15.73:0/3798337298 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f540f5a10 0x7f0f5410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 -- 172.21.15.73:0/3798337298 >> 172.21.15.73:0/3798337298 conn(0x7f0f54113a70 msgr2=0x7f0f540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 -- 172.21.15.73:0/3798337298 shutdown_connections 2024-03-24T10:39:33.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.670 7f0f58ae0700 1 -- 172.21.15.73:0/3798337298 wait complete. 2024-03-24T10:39:33.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.692 7f0f58ae0700 1 Processor -- start 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 -- start start 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f541ac570 0x7f0f540dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 0x7f0f540dd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c5e00 con 0x7f0f540dccf0 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540d67d0 con 0x7f0f541ac570 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f58ae0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540d5cb0 con 0x7f0f541abaf0 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f52051700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 0x7f0f540dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60750/0 (socket says 172.21.15.73:60750) 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f52051700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 0x7f0f540dd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60536/0 (socket says 172.21.15.73:60536) 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 -- 172.21.15.73:0/1335426680 learned_addr learned my addr 172.21.15.73:0/1335426680 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f5104f700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f541ac570 0x7f0f540dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 -- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f541ac570 msgr2=0x7f0f540dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f541ac570 0x7f0f540dc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 -- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 msgr2=0x7f0f540dd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 0x7f0f540dd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 -- 172.21.15.73:0/1335426680 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f541b9cb0 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f51850700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0f541a75d0 tx=0x7f0f4800bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.693 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f541b9cb0 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800ee60 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f541b9eb0 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f4800f040 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f541ba290 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0f48011070 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.694 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0f48010040 con 0x7f0f541abaf0 2024-03-24T10:39:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.695 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f540f08e0 con 0x7f0f541abaf0 2024-03-24T10:39:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.698 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0f4800c620 con 0x7f0f541abaf0 2024-03-24T10:39:33.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.804 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f540a61a0 con 0x7f0f541abaf0 2024-03-24T10:39:33.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.804 7f0f42ffd700 1 -- 172.21.15.73:0/1335426680 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f48000c30 con 0x7f0f541abaf0 2024-03-24T10:39:33.806 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 >> v1:172.21.15.73:6816/43277 conn(0x7f0f300145b0 legacy=0x7f0f30016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 msgr2=0x7f0f541abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0f541a75d0 tx=0x7f0f4800bf70).stop 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 shutdown_connections 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f540dccf0 0x7f0f540dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0f541abaf0 0x7f0f541abf40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 --2- 172.21.15.73:0/1335426680 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f541ac570 0x7f0f540dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 >> 172.21.15.73:0/1335426680 conn(0x7f0f540c58e0 msgr2=0x7f0f540c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 shutdown_connections 2024-03-24T10:39:33.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.806 7f0f58ae0700 1 -- 172.21.15.73:0/1335426680 wait complete. 2024-03-24T10:39:33.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.945 7fc9151d6700 1 Processor -- start 2024-03-24T10:39:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.945 7fc9151d6700 1 -- start start 2024-03-24T10:39:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.945 7fc9151d6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9100f5a10 0x7fc91010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.945 7fc9151d6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.945 7fc9151d6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9101a0a70 con 0x7fc91010bb90 2024-03-24T10:39:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc9151d6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100fa590 con 0x7fc9100f5a10 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc9151d6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101a0c90 con 0x7fc91010b740 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9100f5a10 0x7fc91010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90e5fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc91010bb90 0x7fc9101a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49428/0 (socket says 172.21.15.73:49428) 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90e5fd700 1 -- 172.21.15.73:0/3290966407 learned_addr learned my addr 172.21.15.73:0/3290966407 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45704/0 (socket says 172.21.15.73:45704) 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90cdfa700 1 -- 172.21.15.73:0/3290966407 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133508837 0 0) 0x7fc908001490 con 0x7fc91010bb90 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 -- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 msgr2=0x7fc91019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 -- 172.21.15.73:0/3290966407 >> v1:172.21.15.73:6789/0 conn(0x7fc91010bb90 legacy=0x7fc9101a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 -- 172.21.15.73:0/3290966407 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9101a93d0 con 0x7fc9100f5a10 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90d5fb700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90ddfc700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9100f5a10 0x7fc91010b110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc91010f920 tx=0x7fc90000ba20).ready entity=mon.0 client_cookie=314a9b676d1b711 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90cdfa700 1 -- 172.21.15.73:0/3290966407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9101a93d0 con 0x7fc9100f5a10 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90cdfa700 1 -- 172.21.15.73:0/3290966407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000d5c0 con 0x7fc9100f5a10 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc90cdfa700 1 -- 172.21.15.73:0/3290966407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc90000d990 con 0x7fc9100f5a10 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc9151d6700 1 -- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9100f5a10 msgr2=0x7fc91010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.946 7fc9151d6700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9100f5a10 0x7fc91010b110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc91010f920 tx=0x7fc90000ba20).stop 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 -- 172.21.15.73:0/3290966407 shutdown_connections 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9100f5a10 0x7fc91010b110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 --2- 172.21.15.73:0/3290966407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc91010b740 0x7fc91019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 -- 172.21.15.73:0/3290966407 >> 172.21.15.73:0/3290966407 conn(0x7fc910113a70 msgr2=0x7fc9100f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 -- 172.21.15.73:0/3290966407 shutdown_connections 2024-03-24T10:39:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.947 7fc9151d6700 1 -- 172.21.15.73:0/3290966407 wait complete. 2024-03-24T10:39:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 Processor -- start 2024-03-24T10:39:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 -- start start 2024-03-24T10:39:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101aaae0 0x7fc9101aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 0x7fc9101b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100c4cc0 con 0x7fc9101ab560 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100d0250 con 0x7fc9101b1b10 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc9151d6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101b2590 con 0x7fc9101aaae0 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc90d5fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc90d5fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60554/0 (socket says 172.21.15.73:60554) 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc90d5fb700 1 -- 172.21.15.73:0/59154496 learned_addr learned my addr 172.21.15.73:0/59154496 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.970 7fc90e5fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 0x7fc9101b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90ddfc700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101aaae0 0x7fc9101aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 -- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101aaae0 msgr2=0x7fc9101aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101aaae0 0x7fc9101aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 -- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 msgr2=0x7fc9101b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 0x7fc9101b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 -- 172.21.15.73:0/59154496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100e0a70 con 0x7fc9101ab560 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90e5fd700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 0x7fc9101b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc90d5fb700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc9100d6f00 tx=0x7fc90400bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc9100e0a70 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400e070 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.971 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc904010c30 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.972 7fc9151d6700 1 -- 172.21.15.73:0/59154496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9100f1890 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.972 7fc9151d6700 1 -- 172.21.15.73:0/59154496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9100f1d90 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.972 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc90401e460 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.972 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc904020da0 con 0x7fc9101ab560 2024-03-24T10:39:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.973 7fc9151d6700 1 -- 172.21.15.73:0/59154496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9100f08e0 con 0x7fc9101ab560 2024-03-24T10:39:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:33.976 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc904010640 con 0x7fc9101ab560 2024-03-24T10:39:34.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.080 7fc9151d6700 1 -- 172.21.15.73:0/59154496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9101abc00 con 0x7fc9101ab560 2024-03-24T10:39:34.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.080 7fc8feffd700 1 -- 172.21.15.73:0/59154496 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc904000c30 con 0x7fc9101ab560 2024-03-24T10:39:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 >> v1:172.21.15.73:6816/43277 conn(0x7fc8ec0145b0 legacy=0x7fc8ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 msgr2=0x7fc9101b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc9100d6f00 tx=0x7fc90400bf70).stop 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 shutdown_connections 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9101b1b10 0x7fc9101b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc9101aaae0 0x7fc9101aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 --2- 172.21.15.73:0/59154496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9101ab560 0x7fc9101b14e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 >> 172.21.15.73:0/59154496 conn(0x7fc9100c5c20 msgr2=0x7fc9100d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 shutdown_connections 2024-03-24T10:39:34.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.082 7fc9151d6700 1 -- 172.21.15.73:0/59154496 wait complete. 2024-03-24T10:39:34.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.218 7f7626737700 1 Processor -- start 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.218 7f7626737700 1 -- start start 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f7626737700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 0x7f76201a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f7626737700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f7626737700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762010bce0 con 0x7f76200f5990 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f7626737700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200fa510 con 0x7f762010b890 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f7626737700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76201a0bd0 con 0x7f76201a5950 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761ebaf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 0x7f76201a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45732/0 (socket says 172.21.15.73:45732) 2024-03-24T10:39:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 -- 172.21.15.73:0/1099304058 learned_addr learned my addr 172.21.15.73:0/1099304058 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761f3b0700 1 --1- 172.21.15.73:0/1099304058 >> v1:172.21.15.73:6789/0 conn(0x7f76200f5990 0x7f762010b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49440/0 (socket says 172.21.15.73:49440) 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761e3ae700 1 -- 172.21.15.73:0/1099304058 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089319481 0 0) 0x7f7608001110 con 0x7f76200f5990 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761e3ae700 1 -- 172.21.15.73:0/1099304058 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7600003270 con 0x7f76200f5990 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 -- 172.21.15.73:0/1099304058 >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 msgr2=0x7f76201a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 --2- 172.21.15.73:0/1099304058 >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 0x7f76201a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 -- 172.21.15.73:0/1099304058 >> v1:172.21.15.73:6789/0 conn(0x7f76200f5990 legacy=0x7f762010b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 -- 172.21.15.73:0/1099304058 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76201a93f0 con 0x7f76201a5950 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761ebaf700 1 --2- 172.21.15.73:0/1099304058 >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 0x7f76201a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.219 7f761fbb1700 1 --2- 172.21.15.73:0/1099304058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76200f4740 tx=0x7f7618009d90).ready entity=mon.1 client_cookie=b4dbe54bcde8f2ad server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f761e3ae700 1 -- 172.21.15.73:0/1099304058 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76201a93f0 con 0x7f76201a5950 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f761e3ae700 1 -- 172.21.15.73:0/1099304058 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761800b840 con 0x7f76201a5950 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f761e3ae700 1 -- 172.21.15.73:0/1099304058 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f761800ba20 con 0x7f76201a5950 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 -- 172.21.15.73:0/1099304058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 msgr2=0x7f76201a7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 --2- 172.21.15.73:0/1099304058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76200f4740 tx=0x7f7618009d90).stop 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 -- 172.21.15.73:0/1099304058 shutdown_connections 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 --2- 172.21.15.73:0/1099304058 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76201a5950 0x7f76201a7db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 --2- 172.21.15.73:0/1099304058 >> v2:172.21.15.73:3300/0 conn(0x7f762010b890 0x7f76201a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 -- 172.21.15.73:0/1099304058 >> 172.21.15.73:0/1099304058 conn(0x7f76201139f0 msgr2=0x7f76200f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 -- 172.21.15.73:0/1099304058 shutdown_connections 2024-03-24T10:39:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.220 7f7626737700 1 -- 172.21.15.73:0/1099304058 wait complete. 2024-03-24T10:39:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 Processor -- start 2024-03-24T10:39:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 -- start start 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 0x7f76200d6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200e6520 con 0x7f76200f1e40 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d9b00 con 0x7f76200f2290 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f7626737700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76200d6c50 con 0x7f76200dd840 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761ebaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761f3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761fbb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 0x7f76200d6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761ebaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60570/0 (socket says 172.21.15.73:60570) 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761f3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60764/0 (socket says 172.21.15.73:60764) 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.243 7f761ebaf700 1 -- 172.21.15.73:0/766486275 learned_addr learned my addr 172.21.15.73:0/766486275 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 -- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 msgr2=0x7f76200f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 -- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 msgr2=0x7f76200d6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 0x7f76200d6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 -- 172.21.15.73:0/766486275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76201b9540 con 0x7f76200f1e40 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761fbb1700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 0x7f76200d6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761f3b0700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761ebaf700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f761000c000 tx=0x7f761000eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76201b9540 con 0x7f76200f1e40 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761000c9a0 con 0x7f76200f1e40 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f7626737700 1 -- 172.21.15.73:0/766486275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76200d7770 con 0x7f76200f1e40 2024-03-24T10:39:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f761000f040 con 0x7f76200f1e40 2024-03-24T10:39:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f7626737700 1 -- 172.21.15.73:0/766486275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76200d7c70 con 0x7f76200f1e40 2024-03-24T10:39:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.244 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7610011070 con 0x7f76200f1e40 2024-03-24T10:39:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.245 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7610010040 con 0x7f76200f1e40 2024-03-24T10:39:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.245 7f7626737700 1 -- 172.21.15.73:0/766486275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76200f0860 con 0x7f76200f1e40 2024-03-24T10:39:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.248 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f761000c5a0 con 0x7f76200f1e40 2024-03-24T10:39:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.382 7f7626737700 1 -- 172.21.15.73:0/766486275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76201ac4f0 con 0x7f76200f1e40 2024-03-24T10:39:34.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.383 7f761cbab700 1 -- 172.21.15.73:0/766486275 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f7610000c30 con 0x7f76200f1e40 2024-03-24T10:39:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:34.384 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 >> v1:172.21.15.73:6816/43277 conn(0x7f76040145b0 legacy=0x7f7604016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 msgr2=0x7f76200d5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f761000c000 tx=0x7f761000eca0).stop 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 shutdown_connections 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76200f2290 0x7f76200d6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f76200dd840 0x7f76200f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 --2- 172.21.15.73:0/766486275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76200f1e40 0x7f76200d5ff0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 >> 172.21.15.73:0/766486275 conn(0x7f76200c5680 msgr2=0x7f76200cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 shutdown_connections 2024-03-24T10:39:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.384 7f7626737700 1 -- 172.21.15.73:0/766486275 wait complete. 2024-03-24T10:39:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:34.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 Processor -- start 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 -- start start 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 0x7f419010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41900f9230 con 0x7f41900f2310 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419010f0e0 con 0x7f41900f1ec0 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419728e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41901ac680 con 0x7f41900f5920 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 0x7f419010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60772/0 (socket says 172.21.15.73:60772) 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f419488a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f41900f2310 0x7f419010e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49454/0 (socket says 172.21.15.73:49454) 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 -- 172.21.15.73:0/1462937115 learned_addr learned my addr 172.21.15.73:0/1462937115 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418effd700 1 -- 172.21.15.73:0/1462937115 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331859417 0 0) 0x7f4188001490 con 0x7f41900f2310 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 -- 172.21.15.73:0/1462937115 >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 msgr2=0x7f419010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 --2- 172.21.15.73:0/1462937115 >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 0x7f419010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.521 7f418ffff700 1 -- 172.21.15.73:0/1462937115 >> v1:172.21.15.73:6789/0 conn(0x7f41900f2310 legacy=0x7f419010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418ffff700 1 -- 172.21.15.73:0/1462937115 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41901ac830 con 0x7f41900f5920 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418f7fe700 1 --2- 172.21.15.73:0/1462937115 >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 0x7f419010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418ffff700 1 --2- 172.21.15.73:0/1462937115 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4178002f70 tx=0x7f41780099d0).ready entity=mon.2 client_cookie=1cd9138d6bc16ea5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418effd700 1 -- 172.21.15.73:0/1462937115 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f41901ac830 con 0x7f41900f5920 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418effd700 1 -- 172.21.15.73:0/1462937115 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417800f510 con 0x7f41900f5920 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f418effd700 1 -- 172.21.15.73:0/1462937115 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f417800f6f0 con 0x7f41900f5920 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 -- 172.21.15.73:0/1462937115 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 msgr2=0x7f41900f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 --2- 172.21.15.73:0/1462937115 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4178002f70 tx=0x7f41780099d0).stop 2024-03-24T10:39:34.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 -- 172.21.15.73:0/1462937115 shutdown_connections 2024-03-24T10:39:34.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 --2- 172.21.15.73:0/1462937115 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41900f5920 0x7f41900f1890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 --2- 172.21.15.73:0/1462937115 >> v2:172.21.15.73:3300/0 conn(0x7f41900f1ec0 0x7f419010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 -- 172.21.15.73:0/1462937115 >> 172.21.15.73:0/1462937115 conn(0x7f4190113a70 msgr2=0x7f41900f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 -- 172.21.15.73:0/1462937115 shutdown_connections 2024-03-24T10:39:34.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.522 7f419728e700 1 -- 172.21.15.73:0/1462937115 wait complete. 2024-03-24T10:39:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.545 7f419728e700 1 Processor -- start 2024-03-24T10:39:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.545 7f419728e700 1 -- start start 2024-03-24T10:39:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 0x7f41901b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41900cea70 con 0x7f41900d2cc0 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41900cf000 con 0x7f41900d3740 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41900c50c0 con 0x7f41901b4ee0 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419488a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 0x7f41901b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60580/0 (socket says 172.21.15.73:60580) 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419488a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60782/0 (socket says 172.21.15.73:60782) 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418ffff700 1 -- 172.21.15.73:0/1185782210 learned_addr learned my addr 172.21.15.73:0/1185782210 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 -- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 msgr2=0x7f41901bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 -- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 msgr2=0x7f41900d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 -- 172.21.15.73:0/1185782210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900d3e30 con 0x7f41900d3740 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418ffff700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419488a700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418f7fe700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 0x7f41901b48b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f41900dc930 tx=0x7f418000ebc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f41900d3e30 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180010780 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 -- 172.21.15.73:0/1185782210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41901b5330 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f418000f040 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.546 7f419728e700 1 -- 172.21.15.73:0/1185782210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41901bc130 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.547 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4180011070 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.547 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4180010040 con 0x7f41900d3740 2024-03-24T10:39:34.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.547 7f419728e700 1 -- 172.21.15.73:0/1185782210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41900f08e0 con 0x7f41900d3740 2024-03-24T10:39:34.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.551 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4180010380 con 0x7f41900d3740 2024-03-24T10:39:34.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.656 7f419728e700 1 -- 172.21.15.73:0/1185782210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41900e2f80 con 0x7f41900d3740 2024-03-24T10:39:34.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.657 7f418d7fa700 1 -- 172.21.15.73:0/1185782210 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f4180000c30 con 0x7f41900d3740 2024-03-24T10:39:34.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:34.658 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:34.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 >> v1:172.21.15.73:6816/43277 conn(0x7f41740145b0 legacy=0x7f4174016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 msgr2=0x7f41901b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 0x7f41901b48b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f41900dc930 tx=0x7f418000ebc0).stop 2024-03-24T10:39:34.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 shutdown_connections 2024-03-24T10:39:34.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f41901b4ee0 0x7f41901bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41900d2cc0 0x7f41900d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 --2- 172.21.15.73:0/1185782210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41900d3740 0x7f41901b48b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 >> 172.21.15.73:0/1185782210 conn(0x7f41900c2e90 msgr2=0x7f41900bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 shutdown_connections 2024-03-24T10:39:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.658 7f419728e700 1 -- 172.21.15.73:0/1185782210 wait complete. 2024-03-24T10:39:34.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:34.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.798 7f74a52f3700 1 Processor -- start 2024-03-24T10:39:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.798 7f74a52f3700 1 -- start start 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f74a52f3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 0x7f74a01a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f74a52f3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 0x7f74a01ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f74a52f3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00f9230 con 0x7f74a00f5920 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f74a52f3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00f24e0 con 0x7f74a01a8c80 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f74a52f3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00f26e0 con 0x7f74a00f2090 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749e85d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 0x7f74a01ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749e05c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f74a00f5920 0x7f74a00f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49470/0 (socket says 172.21.15.73:49470) 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 0x7f74a01a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749e05c700 1 -- 172.21.15.73:0/2115646545 learned_addr learned my addr 172.21.15.73:0/2115646545 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 -- 172.21.15.73:0/2115646545 >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 msgr2=0x7f74a01ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 --2- 172.21.15.73:0/2115646545 >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 0x7f74a01ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 -- 172.21.15.73:0/2115646545 >> v1:172.21.15.73:6789/0 conn(0x7f74a00f5920 legacy=0x7f74a00f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 -- 172.21.15.73:0/2115646545 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a01ac720 con 0x7f74a00f2090 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749e85d700 1 --2- 172.21.15.73:0/2115646545 >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 0x7f74a01ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.799 7f749d85b700 1 --2- 172.21.15.73:0/2115646545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 0x7f74a01a8650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7490002f70 tx=0x7f749000b970).ready entity=mon.2 client_cookie=bd8cb1204951a484 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f749d05a700 1 -- 172.21.15.73:0/2115646545 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74a01ac720 con 0x7f74a00f2090 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f749d05a700 1 -- 172.21.15.73:0/2115646545 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000d5c0 con 0x7f74a00f2090 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f749d05a700 1 -- 172.21.15.73:0/2115646545 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f749000d9e0 con 0x7f74a00f2090 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 -- 172.21.15.73:0/2115646545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 msgr2=0x7f74a01a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 --2- 172.21.15.73:0/2115646545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 0x7f74a01a8650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7490002f70 tx=0x7f749000b970).stop 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 -- 172.21.15.73:0/2115646545 shutdown_connections 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 --2- 172.21.15.73:0/2115646545 >> v2:172.21.15.73:3300/0 conn(0x7f74a01a8c80 0x7f74a01ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 --2- 172.21.15.73:0/2115646545 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a00f2090 0x7f74a01a8650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 -- 172.21.15.73:0/2115646545 >> 172.21.15.73:0/2115646545 conn(0x7f74a0113a70 msgr2=0x7f74a00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 -- 172.21.15.73:0/2115646545 shutdown_connections 2024-03-24T10:39:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.800 7f74a52f3700 1 -- 172.21.15.73:0/2115646545 wait complete. 2024-03-24T10:39:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 Processor -- start 2024-03-24T10:39:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 -- start start 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 0x7f74a01b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00de810 con 0x7f74a01b1d30 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01a61f0 con 0x7f74a01a51a0 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f74a52f3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00c7810 con 0x7f74a01a5c20 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749e05c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749d85b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 0x7f74a01b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749e85d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749e05c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45758/0 (socket says 172.21.15.73:45758) 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749d85b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 0x7f74a01b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60788/0 (socket says 172.21.15.73:60788) 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749e05c700 1 -- 172.21.15.73:0/1518398399 learned_addr learned my addr 172.21.15.73:0/1518398399 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.823 7f749e85d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60594/0 (socket says 172.21.15.73:60594) 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 -- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 msgr2=0x7f74a01b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 0x7f74a01b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 -- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 msgr2=0x7f74a01a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 -- 172.21.15.73:0/1518398399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a01b2180 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e05c700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f749e85d700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f749800c000 tx=0x7f749800ed40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74a01b2180 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800c880 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.824 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f749800f040 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.825 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a01b24a0 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.825 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a01bc8f0 con 0x7f74a01b1d30 2024-03-24T10:39:34.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.825 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7498011070 con 0x7f74a01b1d30 2024-03-24T10:39:34.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.825 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7498010040 con 0x7f74a01b1d30 2024-03-24T10:39:34.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.826 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a00f08e0 con 0x7f74a01b1d30 2024-03-24T10:39:34.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.829 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f749800c670 con 0x7f74a01b1d30 2024-03-24T10:39:34.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.934 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74a00d5590 con 0x7f74a01b1d30 2024-03-24T10:39:34.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.934 7f748f7fe700 1 -- 172.21.15.73:0/1518398399 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74a01145f0 con 0x7f74a01b1d30 2024-03-24T10:39:34.935 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.935 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 >> v1:172.21.15.73:6816/43277 conn(0x7f747c0145b0 legacy=0x7f747c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.935 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 msgr2=0x7f74a01bc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.935 7f74a52f3700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f749800c000 tx=0x7f749800ed40).stop 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 shutdown_connections 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a01b1d30 0x7f74a01bc0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74a01a51a0 0x7f74a01a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 --2- 172.21.15.73:0/1518398399 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74a01a5c20 0x7f74a01b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 >> 172.21.15.73:0/1518398399 conn(0x7f74a01a7b50 msgr2=0x7f74a00da9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 shutdown_connections 2024-03-24T10:39:34.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:34.936 7f74a52f3700 1 -- 172.21.15.73:0/1518398399 wait complete. 2024-03-24T10:39:34.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:35.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.074 7f8a43f2c700 1 Processor -- start 2024-03-24T10:39:35.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.074 7f8a43f2c700 1 -- start start 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a43f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a43f2c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 0x7f8a3c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a43f2c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c1a0a70 con 0x7f8a3c10bb90 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a43f2c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0fa590 con 0x7f8a3c0f5a10 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a43f2c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1a0c90 con 0x7f8a3c10b740 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45774/0 (socket says 172.21.15.73:45774) 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a41528700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8a3c10bb90 0x7f8a3c1a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49474/0 (socket says 172.21.15.73:49474) 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 -- 172.21.15.73:0/2880213505 learned_addr learned my addr 172.21.15.73:0/2880213505 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a3bfff700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 0x7f8a3c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 -- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 msgr2=0x7f8a3c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 0x7f8a3c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a3b7fe700 1 -- 172.21.15.73:0/2880213505 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733464708 0 0) 0x7f8a34001490 con 0x7f8a3c10bb90 2024-03-24T10:39:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 -- 172.21.15.73:0/2880213505 >> v1:172.21.15.73:6789/0 conn(0x7f8a3c10bb90 legacy=0x7f8a3c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 -- 172.21.15.73:0/2880213505 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c1a93d0 con 0x7f8a3c0f5a10 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a3bfff700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 0x7f8a3c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.075 7f8a40d27700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a3c10c220 tx=0x7f8a30009ab0).ready entity=mon.1 client_cookie=983a929179f13a40 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a3b7fe700 1 -- 172.21.15.73:0/2880213505 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a3c1a93d0 con 0x7f8a3c0f5a10 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a3b7fe700 1 -- 172.21.15.73:0/2880213505 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000f8a0 con 0x7f8a3c0f5a10 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a3b7fe700 1 -- 172.21.15.73:0/2880213505 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a3000fc70 con 0x7f8a3c0f5a10 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 -- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 msgr2=0x7f8a3c10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a3c10c220 tx=0x7f8a30009ab0).stop 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 -- 172.21.15.73:0/2880213505 shutdown_connections 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c0f5a10 0x7f8a3c10b110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 --2- 172.21.15.73:0/2880213505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c10b740 0x7f8a3c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 -- 172.21.15.73:0/2880213505 >> 172.21.15.73:0/2880213505 conn(0x7f8a3c113a70 msgr2=0x7f8a3c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 -- 172.21.15.73:0/2880213505 shutdown_connections 2024-03-24T10:39:35.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.076 7f8a43f2c700 1 -- 172.21.15.73:0/2880213505 wait complete. 2024-03-24T10:39:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.099 7f8a43f2c700 1 Processor -- start 2024-03-24T10:39:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.099 7f8a43f2c700 1 -- start start 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.099 7f8a43f2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 0x7f8a3c1acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c1afee0 0x7f8a3c1b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0dcdb0 con 0x7f8a3c1acb80 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0c3b00 con 0x7f8a3c1b0960 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cd610 con 0x7f8a3c1afee0 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a3bfff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c1afee0 0x7f8a3c1b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a40d27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 0x7f8a3c1acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45782/0 (socket says 172.21.15.73:45782) 2024-03-24T10:39:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 -- 172.21.15.73:0/888177025 learned_addr learned my addr 172.21.15.73:0/888177025 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 -- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c1afee0 msgr2=0x7f8a3c1b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c1afee0 0x7f8a3c1b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 -- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 msgr2=0x7f8a3c1acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 0x7f8a3c1acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 -- 172.21.15.73:0/888177025 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0dd410 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a40d27700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 0x7f8a3c1acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a41528700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8a34000f40 tx=0x7f8a3400cbb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a3c0dd410 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34005af0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a34007110 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c1b0db0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.100 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c1ad7e0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.101 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8a3401a020 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.101 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8a34009d90 con 0x7f8a3c1b0960 2024-03-24T10:39:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.101 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c0f08e0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.104 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8a340058e0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.213 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a3c0cf1f0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.214 7f8a39ffb700 1 -- 172.21.15.73:0/888177025 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a3c1145f0 con 0x7f8a3c1b0960 2024-03-24T10:39:35.215 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 >> v1:172.21.15.73:6816/43277 conn(0x7f8a240145b0 legacy=0x7f8a24016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 msgr2=0x7f8a3c1b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8a34000f40 tx=0x7f8a3400cbb0).stop 2024-03-24T10:39:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 shutdown_connections 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a3c1b0960 0x7f8a3c1b73c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a3c1acb80 0x7f8a3c1acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 --2- 172.21.15.73:0/888177025 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a3c1afee0 0x7f8a3c1b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 >> 172.21.15.73:0/888177025 conn(0x7f8a3c0e0680 msgr2=0x7f8a3c1a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 shutdown_connections 2024-03-24T10:39:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.215 7f8a43f2c700 1 -- 172.21.15.73:0/888177025 wait complete. 2024-03-24T10:39:35.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.355 7f98cd2bd700 1 Processor -- start 2024-03-24T10:39:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.355 7f98cd2bd700 1 -- start start 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 0x7f98c819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98c810bb90 0x7f98c81a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c80fa590 con 0x7f98c810bb90 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81a08a0 con 0x7f98c810b740 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98cd2bd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81a0ad0 con 0x7f98c80f5a10 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98c810bb90 0x7f98c81a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c585b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 0x7f98c819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98c810bb90 0x7f98c81a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60618/0 (socket says 172.21.15.73:60618) 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60812/0 (socket says 172.21.15.73:60812) 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 -- 172.21.15.73:0/2265602809 learned_addr learned my addr 172.21.15.73:0/2265602809 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 -- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 msgr2=0x7f98c810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 -- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 msgr2=0x7f98c819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 0x7f98c819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c685d700 1 -- 172.21.15.73:0/2265602809 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c81a73b0 con 0x7f98c810bb90 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c605c700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.356 7f98c585b700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 0x7f98c819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98c685d700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c810bb90 0x7f98c81a0270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f98c00032f0 tx=0x7f98c000f330).ready entity=mon.0 client_cookie=8091699713131a12 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98c505a700 1 -- 172.21.15.73:0/2265602809 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f98c81a73b0 con 0x7f98c810bb90 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98c505a700 1 -- 172.21.15.73:0/2265602809 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000fa50 con 0x7f98c810bb90 2024-03-24T10:39:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98c505a700 1 -- 172.21.15.73:0/2265602809 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f98c0013070 con 0x7f98c810bb90 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 -- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c810bb90 msgr2=0x7f98c81a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c810bb90 0x7f98c81a0270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f98c00032f0 tx=0x7f98c000f330).stop 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 -- 172.21.15.73:0/2265602809 shutdown_connections 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c810bb90 0x7f98c81a0270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80f5a10 0x7f98c810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 --2- 172.21.15.73:0/2265602809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c810b740 0x7f98c819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 -- 172.21.15.73:0/2265602809 >> 172.21.15.73:0/2265602809 conn(0x7f98c8113a70 msgr2=0x7f98c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 -- 172.21.15.73:0/2265602809 shutdown_connections 2024-03-24T10:39:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.357 7f98cd2bd700 1 -- 172.21.15.73:0/2265602809 wait complete. 2024-03-24T10:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 Processor -- start 2024-03-24T10:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 -- start start 2024-03-24T10:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 0x7f98c80cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80ccaf0 con 0x7f98c80d5b10 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80c8140 con 0x7f98c80c7b10 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.380 7f98cd2bd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80cb6e0 con 0x7f98c80d56c0 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c605c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c605c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45798/0 (socket says 172.21.15.73:45798) 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60814/0 (socket says 172.21.15.73:60814) 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c605c700 1 -- 172.21.15.73:0/3065698386 learned_addr learned my addr 172.21.15.73:0/3065698386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c685d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 0x7f98c80cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 -- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 msgr2=0x7f98c80d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 -- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 msgr2=0x7f98c80cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 0x7f98c80cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 -- 172.21.15.73:0/3065698386 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80cb910 con 0x7f98c80d56c0 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c605c700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c685d700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 0x7f98c80cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98c585b700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f98bc009000 tx=0x7f98bc00edb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f98bc00c9c0 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc014030 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c81b72c0 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f98bc00cdb0 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.381 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c81b76a0 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.382 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f98bc020070 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.382 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f98bc007d30 con 0x7f98c80d56c0 2024-03-24T10:39:35.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.382 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c80f08e0 con 0x7f98c80d56c0 2024-03-24T10:39:35.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.386 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f98bc00c7b0 con 0x7f98c80d56c0 2024-03-24T10:39:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.491 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98c81aa390 con 0x7f98c80d56c0 2024-03-24T10:39:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.491 7f98b77fe700 1 -- 172.21.15.73:0/3065698386 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98bc000c30 con 0x7f98c80d56c0 2024-03-24T10:39:35.492 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 >> v1:172.21.15.73:6816/43277 conn(0x7f98a40145b0 legacy=0x7f98a4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 msgr2=0x7f98c80caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f98bc009000 tx=0x7f98bc00edb0).stop 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 shutdown_connections 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c80d5b10 0x7f98c80cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f98c80c7b10 0x7f98c80d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 --2- 172.21.15.73:0/3065698386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f98c80d56c0 0x7f98c80caa80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 >> 172.21.15.73:0/3065698386 conn(0x7f98c80c8e60 msgr2=0x7f98c80cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 shutdown_connections 2024-03-24T10:39:35.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.492 7f98cd2bd700 1 -- 172.21.15.73:0/3065698386 wait complete. 2024-03-24T10:39:35.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.629 7fc42a265700 1 Processor -- start 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 -- start start 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 0x7fc4241a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42410bce0 con 0x7fc4240f5990 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4240fa510 con 0x7fc4241a5950 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc42a265700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4241a0bd0 con 0x7fc42410b890 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60822/0 (socket says 172.21.15.73:60822) 2024-03-24T10:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 -- 172.21.15.73:0/1200554637 learned_addr learned my addr 172.21.15.73:0/1200554637 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc423802700 1 --2- 172.21.15.73:0/1200554637 >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 0x7fc4241a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 -- 172.21.15.73:0/1200554637 >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 msgr2=0x7fc4241a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 --2- 172.21.15.73:0/1200554637 >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 0x7fc4241a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.630 7fc41a800700 1 -- 172.21.15.73:0/1200554637 >> v1:172.21.15.73:6789/0 conn(0x7fc4240f5990 legacy=0x7fc42410b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc41a800700 1 -- 172.21.15.73:0/1200554637 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4241a93f0 con 0x7fc42410b890 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc423802700 1 --2- 172.21.15.73:0/1200554637 >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 0x7fc4241a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc41a800700 1 --2- 172.21.15.73:0/1200554637 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc424103990 tx=0x7fc40c00bc30).ready entity=mon.2 client_cookie=662b5e85b9e9543 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc422800700 1 -- 172.21.15.73:0/1200554637 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4241a93f0 con 0x7fc42410b890 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc422800700 1 -- 172.21.15.73:0/1200554637 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c00dc40 con 0x7fc42410b890 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc422800700 1 -- 172.21.15.73:0/1200554637 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc40c010660 con 0x7fc42410b890 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc42a265700 1 -- 172.21.15.73:0/1200554637 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 msgr2=0x7fc4241a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.631 7fc42a265700 1 --2- 172.21.15.73:0/1200554637 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc424103990 tx=0x7fc40c00bc30).stop 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 -- 172.21.15.73:0/1200554637 shutdown_connections 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 --2- 172.21.15.73:0/1200554637 >> v2:172.21.15.73:3300/0 conn(0x7fc4241a5950 0x7fc4241a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 --2- 172.21.15.73:0/1200554637 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc42410b890 0x7fc4241a5320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 -- 172.21.15.73:0/1200554637 >> 172.21.15.73:0/1200554637 conn(0x7fc4241139f0 msgr2=0x7fc4240f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 -- 172.21.15.73:0/1200554637 shutdown_connections 2024-03-24T10:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.632 7fc42a265700 1 -- 172.21.15.73:0/1200554637 wait complete. 2024-03-24T10:39:35.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 Processor -- start 2024-03-24T10:39:35.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 -- start start 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 0x7fc4240d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4240e6520 con 0x7fc4240ca390 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4240ccff0 con 0x7fc4240d5820 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc42a265700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4241b0b00 con 0x7fc4240d5c70 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc41a800700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc423802700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.655 7fc423001700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 0x7fc4240d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423802700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60826/0 (socket says 172.21.15.73:60826) 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc41a800700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45806/0 (socket says 172.21.15.73:45806) 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423802700 1 -- 172.21.15.73:0/1127642707 learned_addr learned my addr 172.21.15.73:0/1127642707 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 -- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 msgr2=0x7fc4241b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 -- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 msgr2=0x7fc4241afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 -- 172.21.15.73:0/1127642707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4241b0d30 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc41a800700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423802700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc423001700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 0x7fc4240d51f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc414000bc0 tx=0x7fc41400c7e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4241b0d30 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414007030 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.656 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc414006520 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.657 7fc42a265700 1 -- 172.21.15.73:0/1127642707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4241b7610 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.657 7fc42a265700 1 -- 172.21.15.73:0/1127642707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4241b79f0 con 0x7fc4240ca390 2024-03-24T10:39:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.657 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc41401a020 con 0x7fc4240ca390 2024-03-24T10:39:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.657 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc414003c20 con 0x7fc4240ca390 2024-03-24T10:39:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.658 7fc42a265700 1 -- 172.21.15.73:0/1127642707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4240f0860 con 0x7fc4240ca390 2024-03-24T10:39:35.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.661 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc41400cdd0 con 0x7fc4240ca390 2024-03-24T10:39:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.797 7fc42a265700 1 -- 172.21.15.73:0/1127642707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4241aa5a0 con 0x7fc4240ca390 2024-03-24T10:39:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.798 7fc420ffd700 1 -- 172.21.15.73:0/1127642707 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7fc414000c30 con 0x7fc4240ca390 2024-03-24T10:39:35.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:35.799 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 >> v1:172.21.15.73:6816/43277 conn(0x7fc4080145b0 legacy=0x7fc408016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 msgr2=0x7fc4240d51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 0x7fc4240d51f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc414000bc0 tx=0x7fc41400c7e0).stop 2024-03-24T10:39:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 shutdown_connections 2024-03-24T10:39:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc4240d5c70 0x7fc4241b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4240ca390 0x7fc4240d51f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 --2- 172.21.15.73:0/1127642707 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4240d5820 0x7fc4241afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 >> 172.21.15.73:0/1127642707 conn(0x7fc4240c46f0 msgr2=0x7fc4240c2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 shutdown_connections 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.799 7fc42a265700 1 -- 172.21.15.73:0/1127642707 wait complete. 2024-03-24T10:39:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:35.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:35.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.935 7fe2870d7700 1 Processor -- start 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.935 7fe2870d7700 1 -- start start 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe2870d7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 0x7fe2800f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe2870d7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe2870d7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800f9230 con 0x7fe2800f2310 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe2870d7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28010f0e0 con 0x7fe2800f1ec0 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe2870d7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801ac680 con 0x7fe2800f5920 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27f7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 0x7fe2800f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45808/0 (socket says 172.21.15.73:45808) 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 -- 172.21.15.73:0/3565679954 learned_addr learned my addr 172.21.15.73:0/3565679954 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27ffff700 1 --1- 172.21.15.73:0/3565679954 >> v1:172.21.15.73:6789/0 conn(0x7fe2800f2310 0x7fe28010e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49486/0 (socket says 172.21.15.73:49486) 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 -- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 msgr2=0x7fe2800f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:35.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 0x7fe2800f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 -- 172.21.15.73:0/3565679954 >> v1:172.21.15.73:6789/0 conn(0x7fe2800f2310 legacy=0x7fe28010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 -- 172.21.15.73:0/3565679954 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2801ac830 con 0x7fe2800f1ec0 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27e7fc700 1 -- 172.21.15.73:0/3565679954 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662056302 0 0) 0x7fe278001490 con 0x7fe2800f2310 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27f7fe700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 0x7fe2800f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27effd700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe270002f70 tx=0x7fe270009a80).ready entity=mon.1 client_cookie=ade3cd30d5dc22b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27e7fc700 1 -- 172.21.15.73:0/3565679954 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2801ac830 con 0x7fe2800f1ec0 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27e7fc700 1 -- 172.21.15.73:0/3565679954 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27000f510 con 0x7fe2800f1ec0 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.936 7fe27e7fc700 1 -- 172.21.15.73:0/3565679954 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe27000f6f0 con 0x7fe2800f1ec0 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 -- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 msgr2=0x7fe28010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe270002f70 tx=0x7fe270009a80).stop 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 -- 172.21.15.73:0/3565679954 shutdown_connections 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2800f5920 0x7fe2800f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 --2- 172.21.15.73:0/3565679954 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800f1ec0 0x7fe28010e2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 -- 172.21.15.73:0/3565679954 >> 172.21.15.73:0/3565679954 conn(0x7fe280113a70 msgr2=0x7fe2800f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 -- 172.21.15.73:0/3565679954 shutdown_connections 2024-03-24T10:39:35.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.937 7fe2870d7700 1 -- 172.21.15.73:0/3565679954 wait complete. 2024-03-24T10:39:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 Processor -- start 2024-03-24T10:39:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 -- start start 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2801b4ee0 0x7fe2801bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800d2be0 con 0x7fe2800ca240 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800cf1a0 con 0x7fe2800cacc0 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe2870d7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800d6f00 con 0x7fe2801b4ee0 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60646/0 (socket says 172.21.15.73:60646) 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45818/0 (socket says 172.21.15.73:45818) 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27f7fe700 1 -- 172.21.15.73:0/3711047204 learned_addr learned my addr 172.21.15.73:0/3711047204 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.960 7fe27ffff700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2801b4ee0 0x7fe2801bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 -- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2801b4ee0 msgr2=0x7fe2801bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2801b4ee0 0x7fe2801bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 -- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 msgr2=0x7fe2801b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 -- 172.21.15.73:0/3711047204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800cf730 con 0x7fe2800ca240 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27effd700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27f7fe700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe2800d7180 tx=0x7fe27400bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2800cf730 con 0x7fe2800ca240 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27400c9a0 con 0x7fe2800ca240 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2800d7710 con 0x7fe2800ca240 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe27400f040 con 0x7fe2800ca240 2024-03-24T10:39:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2801b5330 con 0x7fe2800ca240 2024-03-24T10:39:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe274011070 con 0x7fe2800ca240 2024-03-24T10:39:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.961 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe274010040 con 0x7fe2800ca240 2024-03-24T10:39:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.962 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2800f08e0 con 0x7fe2800ca240 2024-03-24T10:39:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:35.965 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe27400c5a0 con 0x7fe2800ca240 2024-03-24T10:39:36.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.069 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2800ceea0 con 0x7fe2800ca240 2024-03-24T10:39:36.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.070 7fe27cff9700 1 -- 172.21.15.73:0/3711047204 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7fe274000c30 con 0x7fe2800ca240 2024-03-24T10:39:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:36.071 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:22.712564","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 >> v1:172.21.15.73:6816/43277 conn(0x7fe2600145b0 legacy=0x7fe260016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 msgr2=0x7fe2800ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe2800d7180 tx=0x7fe27400bf70).stop 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 shutdown_connections 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2801b4ee0 0x7fe2801bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ca240 0x7fe2800ca690 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 --2- 172.21.15.73:0/3711047204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2800cacc0 0x7fe2801b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 >> 172.21.15.73:0/3711047204 conn(0x7fe2800dc960 msgr2=0x7fe2800c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 shutdown_connections 2024-03-24T10:39:36.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.071 7fe2870d7700 1 -- 172.21.15.73:0/3711047204 wait complete. 2024-03-24T10:39:36.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.208 7f3f4d81f700 1 Processor -- start 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.208 7f3f4d81f700 1 -- start start 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f4d81f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 0x7f3f481a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f4d81f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 0x7f3f481ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f4d81f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480f9230 con 0x7f3f480f5920 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f4d81f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f480f24e0 con 0x7f3f481a8c80 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f4d81f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480f26e0 con 0x7f3f480f2090 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 0x7f3f481a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f465c5700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f480f5920 0x7f3f480f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49494/0 (socket says 172.21.15.73:49494) 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f465c5700 1 -- 172.21.15.73:0/2092346532 learned_addr learned my addr 172.21.15.73:0/2092346532 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:36.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f46dc6700 1 --2- 172.21.15.73:0/2092346532 >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 0x7f3f481ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 -- 172.21.15.73:0/2092346532 >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 msgr2=0x7f3f481ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 --2- 172.21.15.73:0/2092346532 >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 0x7f3f481ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 -- 172.21.15.73:0/2092346532 >> v1:172.21.15.73:6789/0 conn(0x7f3f480f5920 legacy=0x7f3f480f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f455c3700 1 -- 172.21.15.73:0/2092346532 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036252334 0 0) 0x7f3f3c001110 con 0x7f3f480f5920 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 -- 172.21.15.73:0/2092346532 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f481ac720 con 0x7f3f480f2090 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f46dc6700 1 --2- 172.21.15.73:0/2092346532 >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 0x7f3f481ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f45dc4700 1 --2- 172.21.15.73:0/2092346532 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 0x7f3f481a8650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3f38002f70 tx=0x7f3f3800b970).ready entity=mon.1 client_cookie=f68f54da9dde25c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.209 7f3f455c3700 1 -- 172.21.15.73:0/2092346532 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f481ac720 con 0x7f3f480f2090 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f455c3700 1 -- 172.21.15.73:0/2092346532 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800d5c0 con 0x7f3f480f2090 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f455c3700 1 -- 172.21.15.73:0/2092346532 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f3800d9e0 con 0x7f3f480f2090 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 -- 172.21.15.73:0/2092346532 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 msgr2=0x7f3f481a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 --2- 172.21.15.73:0/2092346532 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 0x7f3f481a8650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3f38002f70 tx=0x7f3f3800b970).stop 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 -- 172.21.15.73:0/2092346532 shutdown_connections 2024-03-24T10:39:36.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 --2- 172.21.15.73:0/2092346532 >> v2:172.21.15.73:3300/0 conn(0x7f3f481a8c80 0x7f3f481ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 --2- 172.21.15.73:0/2092346532 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f480f2090 0x7f3f481a8650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 -- 172.21.15.73:0/2092346532 >> 172.21.15.73:0/2092346532 conn(0x7f3f48113a70 msgr2=0x7f3f480f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 -- 172.21.15.73:0/2092346532 shutdown_connections 2024-03-24T10:39:36.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.210 7f3f4d81f700 1 -- 172.21.15.73:0/2092346532 wait complete. 2024-03-24T10:39:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.233 7f3f4d81f700 1 Processor -- start 2024-03-24T10:39:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.233 7f3f4d81f700 1 -- start start 2024-03-24T10:39:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 0x7f3f481b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 0x7f3f481b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480c8560 con 0x7f3f481b5050 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480d5b10 con 0x7f3f481ae060 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480d39e0 con 0x7f3f481aeae0 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45838/0 (socket says 172.21.15.73:45838) 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 -- 172.21.15.73:0/2504573996 learned_addr learned my addr 172.21.15.73:0/2504573996 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f46dc6700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 0x7f3f481b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f45dc4700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 0x7f3f481b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 -- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 msgr2=0x7f3f481b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 0x7f3f481b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 -- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 msgr2=0x7f3f481b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 0x7f3f481b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 -- 172.21.15.73:0/2504573996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f481bc220 con 0x7f3f481ae060 2024-03-24T10:39:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f45dc4700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 0x7f3f481b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f46dc6700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 0x7f3f481b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f465c5700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3f480da800 tx=0x7f3f3c00c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f481bc220 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c0072e0 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f481bc420 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f3c005810 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.234 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f481bc800 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.235 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3f3c005a10 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.235 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3f3c0148d0 con 0x7f3f481ae060 2024-03-24T10:39:36.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.236 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480f08e0 con 0x7f3f481ae060 2024-03-24T10:39:36.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.239 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3f3c0070d0 con 0x7f3f481ae060 2024-03-24T10:39:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.372 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f480f22c0 con 0x7f3f481ae060 2024-03-24T10:39:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.373 7f3f377fe700 1 -- 172.21.15.73:0/2504573996 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f3f3c000c30 con 0x7f3f481ae060 2024-03-24T10:39:36.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:36.374 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:36.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 >> v1:172.21.15.73:6816/43277 conn(0x7f3f240145b0 legacy=0x7f3f24016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 msgr2=0x7f3f481ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3f480da800 tx=0x7f3f3c00c860).stop 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 shutdown_connections 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f481b5050 0x7f3f481b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f481ae060 0x7f3f481ae4b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 --2- 172.21.15.73:0/2504573996 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f481aeae0 0x7f3f481b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 >> 172.21.15.73:0/2504573996 conn(0x7f3f481a7e20 msgr2=0x7f3f480dac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 shutdown_connections 2024-03-24T10:39:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.374 7f3f4d81f700 1 -- 172.21.15.73:0/2504573996 wait complete. 2024-03-24T10:39:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:36.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-24 10:39:21.708322', 'modified': '2024-03-24 10:39:23.715352', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4212}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4212': {'gid': 4212, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6817/319226592', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.73:6817', 'nonce': 319226592}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-24T10:39:36.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-24T10:39:36.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 Processor -- start 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 -- start start 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83d00f2080 0x7f83d01a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d00f9220 con 0x7f83d00f5910 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00f24d0 con 0x7f83d00f2080 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d7924700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01ac710 con 0x7f83d01a8c70 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83cf7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83d00f2080 0x7f83d01a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83cffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f83d00f5910 0x7f83d00f1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49504/0 (socket says 172.21.15.73:49504) 2024-03-24T10:39:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45846/0 (socket says 172.21.15.73:45846) 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.614 7f83cffff700 1 -- 172.21.15.73:0/878346385 learned_addr learned my addr 172.21.15.73:0/878346385 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83cf7fe700 1 -- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 msgr2=0x7f83d01ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83cf7fe700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83cf7fe700 1 -- 172.21.15.73:0/878346385 >> v1:172.21.15.73:6789/0 conn(0x7f83d00f5910 legacy=0x7f83d00f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83cf7fe700 1 -- 172.21.15.73:0/878346385 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d01ac8c0 con 0x7f83d00f2080 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83ceffd700 1 -- 172.21.15.73:0/878346385 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408068167 0 0) 0x7f83c0001110 con 0x7f83d00f5910 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83d4f20700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83cf7fe700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00f2080 0x7f83d01a8640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f83d01037e0 tx=0x7f83c400ba20).ready entity=mon.0 client_cookie=5d6cb6dc230117ab server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83ceffd700 1 -- 172.21.15.73:0/878346385 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83d01ac8c0 con 0x7f83d00f2080 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83ceffd700 1 -- 172.21.15.73:0/878346385 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400d5c0 con 0x7f83d00f2080 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83ceffd700 1 -- 172.21.15.73:0/878346385 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c400d990 con 0x7f83d00f2080 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83d7924700 1 -- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00f2080 msgr2=0x7f83d01a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83d7924700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00f2080 0x7f83d01a8640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f83d01037e0 tx=0x7f83c400ba20).stop 2024-03-24T10:39:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83d7924700 1 -- 172.21.15.73:0/878346385 shutdown_connections 2024-03-24T10:39:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.615 7f83d7924700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d01a8c70 0x7f83d01ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.616 7f83d7924700 1 --2- 172.21.15.73:0/878346385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00f2080 0x7f83d01a8640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.616 7f83d7924700 1 -- 172.21.15.73:0/878346385 >> 172.21.15.73:0/878346385 conn(0x7f83d0113a60 msgr2=0x7f83d00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.616 7f83d7924700 1 -- 172.21.15.73:0/878346385 shutdown_connections 2024-03-24T10:39:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.616 7f83d7924700 1 -- 172.21.15.73:0/878346385 wait complete. 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.638 7f83d7924700 1 Processor -- start 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.638 7f83d7924700 1 -- start start 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.638 7f83d7924700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 0x7f83d00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 0x7f83d01b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00f0140 con 0x7f83d00cf080 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00defb0 con 0x7f83d00cec30 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00d5e70 con 0x7f83d00c66e0 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 0x7f83d01b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 0x7f83d00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60686/0 (socket says 172.21.15.73:60686) 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d4f20700 1 -- 172.21.15.73:0/3561157518 learned_addr learned my addr 172.21.15.73:0/3561157518 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 0x7f83d01b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45848/0 (socket says 172.21.15.73:45848) 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 -- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 msgr2=0x7f83d01b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 0x7f83d01b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 -- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 msgr2=0x7f83d01b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 -- 172.21.15.73:0/3561157518 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d01b5670 con 0x7f83d00c66e0 2024-03-24T10:39:36.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d4f20700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cffff700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 0x7f83d00ce600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f83d00e0c90 tx=0x7f83c000c7e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cd7fa700 1 -- 172.21.15.73:0/3561157518 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83d01b5670 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cd7fa700 1 -- 172.21.15.73:0/3561157518 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c00070d0 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 -- 172.21.15.73:0/3561157518 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d01b5990 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83cd7fa700 1 -- 172.21.15.73:0/3561157518 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c0005620 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.639 7f83d7924700 1 -- 172.21.15.73:0/3561157518 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d01bc120 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.640 7f83cd7fa700 1 -- 172.21.15.73:0/3561157518 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f83c0005820 con 0x7f83d00c66e0 2024-03-24T10:39:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.640 7f83cd7fa700 1 -- 172.21.15.73:0/3561157518 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f83c0005220 con 0x7f83d00c66e0 2024-03-24T10:39:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.642 7f83ea1ddb80 1 Processor -- start 2024-03-24T10:39:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.642 7f83ea1ddb80 1 -- start start 2024-03-24T10:39:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c47988c80 con 0x561c47a5d220 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c479a6a40 con 0x561c47a5dca0 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x561c47973e00 con 0x561c47a50f10 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60694/0 (socket says 172.21.15.73:60694) 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83d4f20700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:60868/0 (socket says 172.21.15.73:60868) 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45858/0 (socket says 172.21.15.73:45858) 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cffff700 1 -- 172.21.15.73:0/3967500495 learned_addr learned my addr 172.21.15.73:0/3967500495 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 -- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 msgr2=0x561c47a51360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 -- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 msgr2=0x561c47a5d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 -- 172.21.15.73:0/3967500495 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c47a263a0 con 0x561c47a5dca0 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83d4f20700 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cffff700 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83cf7fe700 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x561c47994610 tx=0x7f83c4006830).ready entity=mon.1 client_cookie=99c61ca053ecd12c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.643 7f83d7924700 1 -- 172.21.15.73:0/3967500495 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x561c47a263a0 con 0x561c47a5dca0 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83d7924700 1 -- 172.21.15.73:0/3967500495 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400d5c0 con 0x561c47a5dca0 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83d7924700 1 -- 172.21.15.73:0/3967500495 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83c400d990 con 0x561c47a5dca0 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 -- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 msgr2=0x561c47a508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x561c47994610 tx=0x7f83c4006830).stop 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 -- 172.21.15.73:0/3967500495 shutdown_connections 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a50f10 0x561c47a51360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a5d220 0x561c47a5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 --2- 172.21.15.73:0/3967500495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a5dca0 0x561c47a508e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 -- 172.21.15.73:0/3967500495 >> 172.21.15.73:0/3967500495 conn(0x561c47a49cc0 msgr2=0x561c47a6b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 -- 172.21.15.73:0/3967500495 shutdown_connections 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.644 7f83ea1ddb80 1 -- 172.21.15.73:0/3967500495 wait complete. 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 -- start start 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 Processor -- start 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a52e00 0x561c47a533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a53e20 0x561c47a78ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c47a67870 con 0x561c47a53e20 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c47a67450 con 0x561c47a539d0 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x561c47a67190 con 0x561c47a52e00 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83ea1ddb80 10 client.0 ll_register_callbacks cb 0x561c4797ed30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45864/0 (socket says 172.21.15.73:45864) 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 -- 172.21.15.73:0/3889109063 learned_addr learned my addr 172.21.15.73:0/3889109063 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83d4f20700 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a53e20 0x561c47a78ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cffff700 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a52e00 0x561c47a533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 -- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a52e00 msgr2=0x561c47a533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a52e00 0x561c47a533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 -- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a53e20 msgr2=0x561c47a78ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a53e20 0x561c47a78ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.645 7f83cf7fe700 1 -- 172.21.15.73:0/3889109063 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c47896b60 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83cf7fe700 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x561c47994610 tx=0x7f83c4006da0).ready entity=mon.1 client_cookie=54ad9a80503fc81a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x561c47896b60 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c47991cd0 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mon.1 v2:172.21.15.73:3301/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f83c4020a50 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83c400de30 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 10 client.4468 fetch_fsmap learned FSMap version 5 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x561c47a79500 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mon.1 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c47991cd0 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mon.1 v2:172.21.15.73:3301/0 5 ==== fsmap(e 5) v1 ==== 1025+0+0 (secure 0 0 0) 0x7f83c4011070 con 0x561c47a539d0 2024-03-24T10:39:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 10 client.4468 fetch_fsmap finished waiting for FSMap version 5 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 10 client.4468 resolve_mds: resolved ID 'a' to GID 4212 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 20 client.4468 populate_metadata read hostname 'smithi073' 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 4 client.4468 mds_command: new command op to 4212 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 --> v1:172.21.15.73:6817/319226592 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c4788aba0 con 0x561c47a804f0 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.646 7f83aaffd700 10 client.4468 ms_handle_connect on v1:172.21.15.73:6817/319226592 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83aaffd700 1 -- 172.21.15.73:0/3889109063 <== mds.0 v1:172.21.15.73:6817/319226592 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x561c4788aba0 con 0x561c47a804f0 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83aaffd700 10 client.4468 handle_command_reply: tid=0 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 client.4468 shutdown 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 msgr2=0x561c47a788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x561c47994610 tx=0x7f83c4006da0).stop 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 shutdown_connections 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561c47a53e20 0x561c47a78ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x561c47a52e00 0x561c47a533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 --2- 172.21.15.73:0/3889109063 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x561c47a539d0 0x561c47a788a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 >> 172.21.15.73:0/3889109063 conn(0x561c47a4eec0 msgr2=0x561c47a6b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83aaffd700 0 client.4468 ms_handle_reset on v1:172.21.15.73:6817/319226592 2024-03-24T10:39:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 shutdown_connections 2024-03-24T10:39:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 1 -- 172.21.15.73:0/3889109063 wait complete. 2024-03-24T10:39:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.647 7f83ea1ddb80 20 client.4468 trim_cache size 0 max 16384 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 >> v1:172.21.15.73:6816/43277 conn(0x7f83b00145b0 legacy=0x7f83b0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 msgr2=0x7f83d00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 0x7f83d00ce600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f83d00e0c90 tx=0x7f83c000c7e0).stop 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 shutdown_connections 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00cf080 0x7f83d01b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f83d00c66e0 0x7f83d00ce600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 --2- 172.21.15.73:0/3561157518 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d00cec30 0x7f83d01b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 >> 172.21.15.73:0/3561157518 conn(0x7f83d00e10e0 msgr2=0x7f83d00df6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 shutdown_connections 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.657 7f83b57fa700 1 -- 172.21.15.73:0/3561157518 wait complete. 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:injectargs [...] 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:config set 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:config unset 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:exit 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:respawn 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:session kill 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:cpu_profiler status|flush 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:session ls { [...]} 2024-03-24T10:39:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:client ls { [...]} 2024-03-24T10:39:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:session evict { [...]} 2024-03-24T10:39:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:39:36.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:39:36.669 INFO:teuthology.run_tasks:Running task exec... 2024-03-24T10:39:36.678 INFO:teuthology.task.exec:Executing custom commands... 2024-03-24T10:39:36.678 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:39:36.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client nautilus' 2024-03-24T10:39:36.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 Processor -- start 2024-03-24T10:39:36.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 -- start start 2024-03-24T10:39:36.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2381a0a00 con 0x7fa23810b6d0 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380fa520 con 0x7fa2380f59a0 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa23e4a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381a0c20 con 0x7fa23810bb20 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa237a9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa237299700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa237a9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45868/0 (socket says 172.21.15.73:45868) 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa237299700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60706/0 (socket says 172.21.15.73:60706) 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa237a9a700 1 -- 172.21.15.73:0/4101429390 learned_addr learned my addr 172.21.15.73:0/4101429390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.801 7fa236a98700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa23810b6d0 0x7fa23819fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49506/0 (socket says 172.21.15.73:49506) 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237a9a700 1 -- 172.21.15.73:0/4101429390 >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 msgr2=0x7fa23810b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237a9a700 1 --2- 172.21.15.73:0/4101429390 >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237a9a700 1 -- 172.21.15.73:0/4101429390 >> v1:172.21.15.73:6789/0 conn(0x7fa23810b6d0 legacy=0x7fa23819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237a9a700 1 -- 172.21.15.73:0/4101429390 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380f1820 con 0x7fa23810bb20 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa236297700 1 -- 172.21.15.73:0/4101429390 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172165522 0 0) 0x7fa22c001110 con 0x7fa23810b6d0 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237299700 1 --2- 172.21.15.73:0/4101429390 >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa237a9a700 1 --2- 172.21.15.73:0/4101429390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa2380f4750 tx=0x7fa230009d90).ready entity=mon.1 client_cookie=ce4b680e380ea224 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa236297700 1 -- 172.21.15.73:0/4101429390 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2380f1820 con 0x7fa23810bb20 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa236297700 1 -- 172.21.15.73:0/4101429390 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000b840 con 0x7fa23810bb20 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa236297700 1 -- 172.21.15.73:0/4101429390 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23000ba20 con 0x7fa23810bb20 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa23e4a0700 1 -- 172.21.15.73:0/4101429390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 msgr2=0x7fa2381a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.802 7fa23e4a0700 1 --2- 172.21.15.73:0/4101429390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa2380f4750 tx=0x7fa230009d90).stop 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 -- 172.21.15.73:0/4101429390 shutdown_connections 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 --2- 172.21.15.73:0/4101429390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa23810bb20 0x7fa2381a03d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 --2- 172.21.15.73:0/4101429390 >> v2:172.21.15.73:3300/0 conn(0x7fa2380f59a0 0x7fa23810b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 -- 172.21.15.73:0/4101429390 >> 172.21.15.73:0/4101429390 conn(0x7fa238113a00 msgr2=0x7fa2380f50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 -- 172.21.15.73:0/4101429390 shutdown_connections 2024-03-24T10:39:36.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.803 7fa23e4a0700 1 -- 172.21.15.73:0/4101429390 wait complete. 2024-03-24T10:39:36.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.825 7fa23e4a0700 1 Processor -- start 2024-03-24T10:39:36.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 -- start start 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2380d0e30 0x7fa2381ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 0x7fa2381b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380d1280 con 0x7fa2380ba130 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380d6ca0 con 0x7fa2380d0e30 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa23e4a0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381abff0 con 0x7fa2381abba0 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa237299700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa237299700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60720/0 (socket says 172.21.15.73:60720) 2024-03-24T10:39:36.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa237299700 1 -- 172.21.15.73:0/2187917645 learned_addr learned my addr 172.21.15.73:0/2187917645 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa237a9a700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 0x7fa2381b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.826 7fa236a98700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2380d0e30 0x7fa2381ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 -- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2380d0e30 msgr2=0x7fa2381ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2380d0e30 0x7fa2381ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 -- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 msgr2=0x7fa2380d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 -- 172.21.15.73:0/2187917645 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2381ac220 con 0x7fa2381abba0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237299700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa237a9a700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 0x7fa2381b9080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa2380f4750 tx=0x7fa230006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2381ac220 con 0x7fa2381abba0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230011b40 con 0x7fa2381abba0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2381b96b0 con 0x7fa2381abba0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa230021070 con 0x7fa2381abba0 2024-03-24T10:39:36.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2381b9a90 con 0x7fa2381abba0 2024-03-24T10:39:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa230025410 con 0x7fa2381abba0 2024-03-24T10:39:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.827 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa230018030 con 0x7fa2381abba0 2024-03-24T10:39:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.828 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2380f0870 con 0x7fa2381abba0 2024-03-24T10:39:36.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.831 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa230011930 con 0x7fa2381abba0 2024-03-24T10:39:36.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:36.944 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "nautilus"} v 0) v1 -- 0x7fa2380abaf0 con 0x7fa2381abba0 2024-03-24T10:39:37.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.194 7fa234a94700 1 -- 172.21.15.73:0/2187917645 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "nautilus"}]=0 set require_min_compat_client to nautilus v17) v1 ==== 145+0+0 (secure 0 0 0) 0x7fa23000b630 con 0x7fa2381abba0 2024-03-24T10:39:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 >> v1:172.21.15.73:6816/43277 conn(0x7fa2180145b0 legacy=0x7fa218016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 msgr2=0x7fa2381b9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 0x7fa2381b9080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa2380f4750 tx=0x7fa230006c40).stop 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 shutdown_connections 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2381abba0 0x7fa2381b9080 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2380ba130 0x7fa2380d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 --2- 172.21.15.73:0/2187917645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2380d0e30 0x7fa2381ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 >> 172.21.15.73:0/2187917645 conn(0x7fa2380c5800 msgr2=0x7fa2380bfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 shutdown_connections 2024-03-24T10:39:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.196 7fa23e4a0700 1 -- 172.21.15.73:0/2187917645 wait complete. 2024-03-24T10:39:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:set require_min_compat_client to nautilus 2024-03-24T10:39:37.208 INFO:teuthology.run_tasks:Running task print... 2024-03-24T10:39:37.216 INFO:teuthology.task.print:**** done ceph 2024-03-24T10:39:37.216 INFO:teuthology.run_tasks:Running task kclient... 2024-03-24T10:39:37.237 INFO:tasks.kclient:Mounting kernel clients... 2024-03-24T10:39:37.237 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-24T10:39:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:37.237 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-03-24T10:39:37.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:37.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-03-24T10:39:37.363 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-03-24T10:39:37.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:39:37.366 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-24T10:39:37.366 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:39:37.366 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:39:37.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:39:37.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.491 7ff324ff7700 1 Processor -- start 2024-03-24T10:39:37.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.491 7ff324ff7700 1 -- start start 2024-03-24T10:39:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.491 7ff324ff7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 0x7ff3201a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 0x7ff3201ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:37.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200f91b0 con 0x7ff3200f58a0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200f2460 con 0x7ff3201a8c00 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200f2660 con 0x7ff3200f2010 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31dd9f700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff3200f58a0 0x7ff3200f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49508/0 (socket says 172.21.15.73:49508) 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31dd9f700 1 -- 172.21.15.73:0/3445345693 learned_addr learned my addr 172.21.15.73:0/3445345693 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 --2- 172.21.15.73:0/3445345693 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 0x7ff3201a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31e5a0700 1 --2- 172.21.15.73:0/3445345693 >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 0x7ff3201ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31cd9d700 1 -- 172.21.15.73:0/3445345693 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246565802 0 0) 0x7ff310001110 con 0x7ff3200f58a0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31cd9d700 1 -- 172.21.15.73:0/3445345693 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff304003270 con 0x7ff3200f58a0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 -- 172.21.15.73:0/3445345693 >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 msgr2=0x7ff3201ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 --2- 172.21.15.73:0/3445345693 >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 0x7ff3201ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 -- 172.21.15.73:0/3445345693 >> v1:172.21.15.73:6789/0 conn(0x7ff3200f58a0 legacy=0x7ff3200f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 -- 172.21.15.73:0/3445345693 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3201ac6a0 con 0x7ff3200f2010 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31e5a0700 1 --2- 172.21.15.73:0/3445345693 >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 0x7ff3201ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31d59e700 1 --2- 172.21.15.73:0/3445345693 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 0x7ff3201a85d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff314002f70 tx=0x7ff31400b970).ready entity=mon.2 client_cookie=11ada2f7769615d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:37.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31cd9d700 1 -- 172.21.15.73:0/3445345693 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3201ac6a0 con 0x7ff3200f2010 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31cd9d700 1 -- 172.21.15.73:0/3445345693 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400d5c0 con 0x7ff3200f2010 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff31cd9d700 1 -- 172.21.15.73:0/3445345693 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff31400d9e0 con 0x7ff3200f2010 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 -- 172.21.15.73:0/3445345693 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 msgr2=0x7ff3201a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.492 7ff324ff7700 1 --2- 172.21.15.73:0/3445345693 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 0x7ff3201a85d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff314002f70 tx=0x7ff31400b970).stop 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 -- 172.21.15.73:0/3445345693 shutdown_connections 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 --2- 172.21.15.73:0/3445345693 >> v2:172.21.15.73:3300/0 conn(0x7ff3201a8c00 0x7ff3201ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 --2- 172.21.15.73:0/3445345693 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3200f2010 0x7ff3201a85d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 -- 172.21.15.73:0/3445345693 >> 172.21.15.73:0/3445345693 conn(0x7ff3201139f0 msgr2=0x7ff3200f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 -- 172.21.15.73:0/3445345693 shutdown_connections 2024-03-24T10:39:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.493 7ff324ff7700 1 -- 172.21.15.73:0/3445345693 wait complete. 2024-03-24T10:39:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 Processor -- start 2024-03-24T10:39:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 -- start start 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 0x7ff3201b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 0x7ff3201b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200e4430 con 0x7ff3201a7490 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200d7430 con 0x7ff3200c6db0 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.516 7ff324ff7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201b4f30 con 0x7ff3201a78e0 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31dd9f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 0x7ff3201b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31e5a0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 0x7ff3201b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31dd9f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:45878/0 (socket says 172.21.15.73:45878) 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31dd9f700 1 -- 172.21.15.73:0/4126012714 learned_addr learned my addr 172.21.15.73:0/4126012714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 -- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 msgr2=0x7ff3201b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 0x7ff3201b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 -- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 msgr2=0x7ff3201a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 -- 172.21.15.73:0/4126012714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3201b5160 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31e5a0700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 0x7ff3201b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31dd9f700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff31d59e700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 0x7ff3201b42d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff314002f70 tx=0x7ff3140068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3201b5160 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314011a00 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3200ff150 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff314017040 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.517 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200ff650 con 0x7ff3201a7490 2024-03-24T10:39:37.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.518 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff3140273b0 con 0x7ff3201a7490 2024-03-24T10:39:37.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.518 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff314018070 con 0x7ff3201a7490 2024-03-24T10:39:37.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.518 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3200f0860 con 0x7ff3201a7490 2024-03-24T10:39:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.522 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff3140117f0 con 0x7ff3201a7490 2024-03-24T10:39:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.656 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3200f2240 con 0x7ff3201a7490 2024-03-24T10:39:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.657 7ff30effd700 1 -- 172.21.15.73:0/4126012714 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff31400d3b0 con 0x7ff3201a7490 2024-03-24T10:39:37.658 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-24T10:39:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 >> v1:172.21.15.73:6816/43277 conn(0x7ff2fc0145b0 legacy=0x7ff2fc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 msgr2=0x7ff3201b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 0x7ff3201b42d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff314002f70 tx=0x7ff3140068c0).stop 2024-03-24T10:39:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 shutdown_connections 2024-03-24T10:39:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff3201a78e0 0x7ff3201b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3200c6db0 0x7ff3201a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 --2- 172.21.15.73:0/4126012714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3201a7490 0x7ff3201b42d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 >> 172.21.15.73:0/4126012714 conn(0x7ff3200cc380 msgr2=0x7ff3200da430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 shutdown_connections 2024-03-24T10:39:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:37.658 7ff324ff7700 1 -- 172.21.15.73:0/4126012714 wait complete. 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:39:37.670 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:39:37.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:37.670 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:39:37.717 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42571sec preferred_lft 42571sec 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2024-03-24T10:39:37.718 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:39:37.719 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-03-24T10:39:37.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-24T10:39:37.720 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:39:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:38.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:38.228 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:39:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-03-24T10:39:38.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:38.319 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:39:38.396 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:39:38.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:39.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:39.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:39.149 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-03-24T10:39:39.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:39.194 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-03-24T10:39:39.279 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:39:39.279 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:39:39.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:39:39.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-24T10:39:39.279 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:39:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:39.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:39.504 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-24T10:39:39.504 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:39:39.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:39.810 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:39:39.810 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:39:39.810 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-03-24T10:39:39.810 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-03-24T10:39:39.810 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:39:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:40.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:40.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:39:40.025 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-24T10:39:40.068 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:39:40.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:39:40.069 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:39:40.151 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-24T10:39:40.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:40.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:39:40.282 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:39:40.282 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-03-24T10:39:40.283 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-03-24T10:39:40.283 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-03-24T10:39:40.283 INFO:teuthology.orchestra.run.smithi078.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:39:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-03-24T10:39:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-03-24T10:39:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-03-24T10:39:40.885 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:39:40.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:40.886 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:39:40.952 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:39:41.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:39:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:41.118 INFO:teuthology.orchestra.run.smithi078.stdout:client4647 2024-03-24T10:39:41.118 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:39:41.118 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:39:41.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:39:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:39:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:41.359 INFO:teuthology.orchestra.run.smithi078.stdout:client4647 2024-03-24T10:39:41.360 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:39:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:39:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:41.520 INFO:teuthology.orchestra.run.smithi078.stdout:client4647 2024-03-24T10:39:41.521 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7ccdf8d1-529f-44dc-adcb-8e62b7bebc17.client4647/status') 2024-03-24T10:39:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:39:41.691 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4647 (3)172.21.15.78:0/4231369888 2024-03-24T10:39:41.691 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2024-03-24T10:39:41.691 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2024-03-24T10:39:41.691 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2024-03-24T10:39:41.691 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 5.0147e-05 s, 1.4 MB/s 2024-03-24T10:39:41.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:39:41.700 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-24T10:39:41.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.853 7f4893df3700 1 Processor -- start 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.853 7f4893df3700 1 -- start start 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f488c0f5a10 0x7f488c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 0x7f488c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0fa590 con 0x7f488c0f5a10 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1a08a0 con 0x7f488c10b740 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4893df3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1a0ad0 con 0x7f488c10bb90 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f48913ef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f48913ef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48434/0 (socket says 172.21.15.73:48434) 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f48913ef700 1 -- 172.21.15.73:0/4242247653 learned_addr learned my addr 172.21.15.73:0/4242247653 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 0x7f488c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f4890bee700 1 --2- 172.21.15.73:0/4242247653 >> v2:172.21.15.73:3300/0 conn(0x7f488c0f5a10 0x7f488c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 -- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 msgr2=0x7f488c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 -- 172.21.15.73:0/4242247653 >> v2:172.21.15.73:3300/0 conn(0x7f488c0f5a10 msgr2=0x7f488c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 --2- 172.21.15.73:0/4242247653 >> v2:172.21.15.73:3300/0 conn(0x7f488c0f5a10 0x7f488c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 -- 172.21.15.73:0/4242247653 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c1a73b0 con 0x7f488c10b740 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f48913ef700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.854 7f488bfff700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 0x7f488c19fc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f488c0f47c0 tx=0x7f487800ba20).ready entity=mon.1 client_cookie=4201486abc6eb896 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f488b7fe700 1 -- 172.21.15.73:0/4242247653 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f488c1a73b0 con 0x7f488c10b740 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f488b7fe700 1 -- 172.21.15.73:0/4242247653 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800d570 con 0x7f488c10b740 2024-03-24T10:39:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f488b7fe700 1 -- 172.21.15.73:0/4242247653 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f487800d940 con 0x7f488c10b740 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 -- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 msgr2=0x7f488c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 0x7f488c19fc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f488c0f47c0 tx=0x7f487800ba20).stop 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 -- 172.21.15.73:0/4242247653 shutdown_connections 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c10bb90 0x7f488c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 --2- 172.21.15.73:0/4242247653 >> v2:172.21.15.73:3300/0 conn(0x7f488c0f5a10 0x7f488c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 --2- 172.21.15.73:0/4242247653 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c10b740 0x7f488c19fc40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 -- 172.21.15.73:0/4242247653 >> 172.21.15.73:0/4242247653 conn(0x7f488c113a70 msgr2=0x7f488c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 -- 172.21.15.73:0/4242247653 shutdown_connections 2024-03-24T10:39:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.855 7f4893df3700 1 -- 172.21.15.73:0/4242247653 wait complete. 2024-03-24T10:39:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 Processor -- start 2024-03-24T10:39:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 -- start start 2024-03-24T10:39:41.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 0x7f488c1b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:41.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0dc850 con 0x7f488c0cce50 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0dcb10 con 0x7f488c0cca00 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.878 7f4893df3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1b0f20 con 0x7f488c0dd170 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4890bee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f48913ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 0x7f488c1b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35476/0 (socket says 172.21.15.73:35476) 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 -- 172.21.15.73:0/830971507 learned_addr learned my addr 172.21.15.73:0/830971507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4890bee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48442/0 (socket says 172.21.15.73:48442) 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 -- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 msgr2=0x7f488c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 -- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 msgr2=0x7f488c1b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 0x7f488c1b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 -- 172.21.15.73:0/830971507 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c1b1100 con 0x7f488c0cca00 2024-03-24T10:39:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f48913ef700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 0x7f488c1b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4890bee700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f488bfff700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f488c0ce510 tx=0x7f48780068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f488c1b1100 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878006ab0 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4878017040 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4893df3700 1 -- 172.21.15.73:0/830971507 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c1b7ac0 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.879 7f4893df3700 1 -- 172.21.15.73:0/830971507 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c1b7ea0 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.880 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4878011bb0 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.880 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4878018070 con 0x7f488c0cca00 2024-03-24T10:39:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.880 7f4893df3700 1 -- 172.21.15.73:0/830971507 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c0f08e0 con 0x7f488c0cca00 2024-03-24T10:39:41.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.883 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f48780117b0 con 0x7f488c0cca00 2024-03-24T10:39:41.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.990 7f4893df3700 1 -- 172.21.15.73:0/830971507 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488c0e2430 con 0x7f488c0cca00 2024-03-24T10:39:41.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.991 7f4889ffb700 1 -- 172.21.15.73:0/830971507 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f487800d360 con 0x7f488c0cca00 2024-03-24T10:39:41.994 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:41.994 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.992 7f4893df3700 1 -- 172.21.15.73:0/830971507 >> v1:172.21.15.73:6816/43277 conn(0x7f48740145b0 legacy=0x7f4874016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.992 7f4893df3700 1 -- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 msgr2=0x7f488c1b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.992 7f4893df3700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f488c0ce510 tx=0x7f48780068c0).stop 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 -- 172.21.15.73:0/830971507 shutdown_connections 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f488c0cce50 0x7f488c1b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f488c0dd170 0x7f488c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 --2- 172.21.15.73:0/830971507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f488c0cca00 0x7f488c1b02c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 -- 172.21.15.73:0/830971507 >> 172.21.15.73:0/830971507 conn(0x7f488c0e0750 msgr2=0x7f488c0ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:41.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 -- 172.21.15.73:0/830971507 shutdown_connections 2024-03-24T10:39:41.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:41.993 7f4893df3700 1 -- 172.21.15.73:0/830971507 wait complete. 2024-03-24T10:39:42.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:42.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.131 7f3a0b9f0700 1 Processor -- start 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.131 7f3a0b9f0700 1 -- start start 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a0b9f0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a0b9f0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 0x7f3a041a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a0b9f0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a041a0a70 con 0x7f3a0410b740 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a0b9f0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040fa590 con 0x7f3a040f5a10 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a0b9f0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a041a0c90 con 0x7f3a0410bb90 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a03fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 0x7f3a041a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a037fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3a0410b740 0x7f3a0419fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39804/0 (socket says 172.21.15.73:39804) 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a03fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35486/0 (socket says 172.21.15.73:35486) 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a037fe700 1 -- 172.21.15.73:0/643128681 learned_addr learned my addr 172.21.15.73:0/643128681 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 -- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 msgr2=0x7f3a0410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 -- 172.21.15.73:0/643128681 >> v1:172.21.15.73:6789/0 conn(0x7f3a0410b740 legacy=0x7f3a0419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a02ffd700 1 -- 172.21.15.73:0/643128681 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140611679 0 0) 0x7f39f4001110 con 0x7f3a0410b740 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 -- 172.21.15.73:0/643128681 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a041a93d0 con 0x7f3a0410bb90 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a03fff700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.132 7f3a08fec700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 0x7f3a041a0440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3a040f47c0 tx=0x7f39fc009cf0).ready entity=mon.2 client_cookie=dd2d29120b158890 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a02ffd700 1 -- 172.21.15.73:0/643128681 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a041a93d0 con 0x7f3a0410bb90 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a02ffd700 1 -- 172.21.15.73:0/643128681 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00b840 con 0x7f3a0410bb90 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a02ffd700 1 -- 172.21.15.73:0/643128681 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39fc00ba20 con 0x7f3a0410bb90 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 -- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 msgr2=0x7f3a041a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 0x7f3a041a0440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3a040f47c0 tx=0x7f39fc009cf0).stop 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 -- 172.21.15.73:0/643128681 shutdown_connections 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a0410bb90 0x7f3a041a0440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 --2- 172.21.15.73:0/643128681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a040f5a10 0x7f3a0410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 -- 172.21.15.73:0/643128681 >> 172.21.15.73:0/643128681 conn(0x7f3a04113a70 msgr2=0x7f3a040f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 -- 172.21.15.73:0/643128681 shutdown_connections 2024-03-24T10:39:42.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.133 7f3a0b9f0700 1 -- 172.21.15.73:0/643128681 wait complete. 2024-03-24T10:39:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 Processor -- start 2024-03-24T10:39:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 -- start start 2024-03-24T10:39:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 0x7f3a041b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040d4fe0 con 0x7f3a041a5c60 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040c5d90 con 0x7f3a041b2be0 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.156 7f3a0b9f0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040d55a0 con 0x7f3a041a51e0 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a03fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41174/0 (socket says 172.21.15.73:41174) 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a03fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48468/0 (socket says 172.21.15.73:48468) 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 -- 172.21.15.73:0/3524873720 learned_addr learned my addr 172.21.15.73:0/3524873720 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a08fec700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 0x7f3a041b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 -- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 msgr2=0x7f3a041a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 -- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 msgr2=0x7f3a041b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 0x7f3a041b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 -- 172.21.15.73:0/3524873720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040d52e0 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a03fff700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a08fec700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 0x7f3a041b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a037fe700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3a040d5190 tx=0x7f39f400c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a040d52e0 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f40072e0 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a040c35b0 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39f4005810 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.157 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a040c3ab0 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.158 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f39f4005a10 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.158 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f39f4014950 con 0x7f3a041a5c60 2024-03-24T10:39:42.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.158 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a040f08e0 con 0x7f3a041a5c60 2024-03-24T10:39:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.161 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f39f40070d0 con 0x7f3a041a5c60 2024-03-24T10:39:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.268 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a040e2430 con 0x7f3a041a5c60 2024-03-24T10:39:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.268 7f3a017fa700 1 -- 172.21.15.73:0/3524873720 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39f4000c30 con 0x7f3a041a5c60 2024-03-24T10:39:42.270 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 >> v1:172.21.15.73:6816/43277 conn(0x7f39e40145b0 legacy=0x7f39e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 msgr2=0x7f3a041b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3a040d5190 tx=0x7f39f400c860).stop 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 shutdown_connections 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3a041b2be0 0x7f3a041b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3a041a51e0 0x7f3a041a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 --2- 172.21.15.73:0/3524873720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a041a5c60 0x7f3a041b25b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 >> 172.21.15.73:0/3524873720 conn(0x7f3a040c5870 msgr2=0x7f3a040d8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 shutdown_connections 2024-03-24T10:39:42.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.270 7f3a0b9f0700 1 -- 172.21.15.73:0/3524873720 wait complete. 2024-03-24T10:39:42.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 Processor -- start 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 -- start start 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 0x7f72000f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f720010eee0 0x7f72000f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72000fb670 con 0x7f720010eee0 2024-03-24T10:39:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200106980 con 0x7f7200106530 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72085f7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72000f1c60 con 0x7f720010ea90 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f7205bf3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f720010eee0 0x7f72000f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72053f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f7204bf1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 0x7f72000f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f7205bf3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f720010eee0 0x7f72000f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41190/0 (socket says 172.21.15.73:41190) 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f7205bf3700 1 -- 172.21.15.73:0/3485836767 learned_addr learned my addr 172.21.15.73:0/3485836767 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.408 7f72053f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35494/0 (socket says 172.21.15.73:35494) 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 -- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 msgr2=0x7f72000f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 0x7f72000f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 -- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 msgr2=0x7f720010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 -- 172.21.15.73:0/3485836767 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000f1e90 con 0x7f720010eee0 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72053f2700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7204bf1700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 0x7f72000f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f7205bf3700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f720010eee0 0x7f72000f1630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f72000fb820 tx=0x7f71f8009e10).ready entity=mon.0 client_cookie=2752c22237442f76 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f71effff700 1 -- 172.21.15.73:0/3485836767 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72000f1e90 con 0x7f720010eee0 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f71effff700 1 -- 172.21.15.73:0/3485836767 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f800b890 con 0x7f720010eee0 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f71effff700 1 -- 172.21.15.73:0/3485836767 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71f800ba70 con 0x7f720010eee0 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 -- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f720010eee0 msgr2=0x7f72000f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f720010eee0 0x7f72000f1630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f72000fb820 tx=0x7f71f8009e10).stop 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 -- 172.21.15.73:0/3485836767 shutdown_connections 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f720010eee0 0x7f72000f1630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7200106530 0x7f720010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 --2- 172.21.15.73:0/3485836767 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f720010ea90 0x7f72000f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.409 7f72085f7700 1 -- 172.21.15.73:0/3485836767 >> 172.21.15.73:0/3485836767 conn(0x7f7200114940 msgr2=0x7f7200114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.410 7f72085f7700 1 -- 172.21.15.73:0/3485836767 shutdown_connections 2024-03-24T10:39:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.410 7f72085f7700 1 -- 172.21.15.73:0/3485836767 wait complete. 2024-03-24T10:39:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.432 7f72085f7700 1 Processor -- start 2024-03-24T10:39:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.432 7f72085f7700 1 -- start start 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 0x7f72000d64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 0x7f72001b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000e5d00 con 0x7f72001b4980 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000d8ce0 con 0x7f72000d6b20 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72085f7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72000de040 con 0x7f72000d60a0 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7205bf3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 0x7f72001b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35496/0 (socket says 172.21.15.73:35496) 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 -- 172.21.15.73:0/2392829651 learned_addr learned my addr 172.21.15.73:0/2392829651 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72053f2700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 0x7f72000d64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 -- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 msgr2=0x7f72000d64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 0x7f72000d64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 -- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 msgr2=0x7f72001b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 0x7f72001b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7204bf1700 1 -- 172.21.15.73:0/2392829651 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000d8990 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f7205bf3700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 0x7f72001b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.433 7f72053f2700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 0x7f72000d64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f7204bf1700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f72000d90c0 tx=0x7f71fc00ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72000d8990 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00c790 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f72085f7700 1 -- 172.21.15.73:0/2392829651 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72000c4600 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f72085f7700 1 -- 172.21.15.73:0/2392829651 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72000ddbf0 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f71fc011070 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.434 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f71fc010040 con 0x7f72000d6b20 2024-03-24T10:39:42.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.435 7f72085f7700 1 -- 172.21.15.73:0/2392829651 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72000f08e0 con 0x7f72000d6b20 2024-03-24T10:39:42.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.438 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f71fc00ee10 con 0x7f72000d6b20 2024-03-24T10:39:42.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.544 7f72085f7700 1 -- 172.21.15.73:0/2392829651 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72001aea50 con 0x7f72000d6b20 2024-03-24T10:39:42.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.544 7f71ee7fc700 1 -- 172.21.15.73:0/2392829651 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71fc000c30 con 0x7f72000d6b20 2024-03-24T10:39:42.546 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 >> v1:172.21.15.73:6816/43277 conn(0x7f71e00145b0 legacy=0x7f71e0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 msgr2=0x7f72001b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f72000d90c0 tx=0x7f71fc00ecd0).stop 2024-03-24T10:39:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 shutdown_connections 2024-03-24T10:39:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72001b4980 0x7f72001b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f72000d60a0 0x7f72000d64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 --2- 172.21.15.73:0/2392829651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72000d6b20 0x7f72001b4350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 >> 172.21.15.73:0/2392829651 conn(0x7f72000c5700 msgr2=0x7f72000cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 shutdown_connections 2024-03-24T10:39:42.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.546 7f72085f7700 1 -- 172.21.15.73:0/2392829651 wait complete. 2024-03-24T10:39:42.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 Processor -- start 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 -- start start 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 0x7fd1ac10b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0fa510 con 0x7fd1ac10b6c0 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1a0820 con 0x7fd1ac10bb10 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.684 7fd1b32cb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1a0a50 con 0x7fd1ac0f5990 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1ab7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1abfff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 0x7fd1ac10b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1ab7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41220/0 (socket says 172.21.15.73:41220) 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35502/0 (socket says 172.21.15.73:35502) 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1ab7fe700 1 -- 172.21.15.73:0/3059132470 learned_addr learned my addr 172.21.15.73:0/3059132470 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 -- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 msgr2=0x7fd1ac10b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 0x7fd1ac10b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 -- 172.21.15.73:0/3059132470 >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 msgr2=0x7fd1ac19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 --2- 172.21.15.73:0/3059132470 >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 -- 172.21.15.73:0/3059132470 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac1a7330 con 0x7fd1ac10bb10 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1ab7fe700 1 --2- 172.21.15.73:0/3059132470 >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1abfff700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 0x7fd1ac10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b08c7700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd1ac0f4740 tx=0x7fd1a4009d40).ready entity=mon.1 client_cookie=6975cea444cd5bd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1aaffd700 1 -- 172.21.15.73:0/3059132470 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1ac1a7330 con 0x7fd1ac10bb10 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1aaffd700 1 -- 172.21.15.73:0/3059132470 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400b7c0 con 0x7fd1ac10bb10 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1aaffd700 1 -- 172.21.15.73:0/3059132470 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a400b9a0 con 0x7fd1ac10bb10 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b32cb700 1 -- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 msgr2=0x7fd1ac1a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.685 7fd1b32cb700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd1ac0f4740 tx=0x7fd1a4009d40).stop 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 -- 172.21.15.73:0/3059132470 shutdown_connections 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac10bb10 0x7fd1ac1a01f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 --2- 172.21.15.73:0/3059132470 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0f5990 0x7fd1ac10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 --2- 172.21.15.73:0/3059132470 >> v2:172.21.15.73:3300/0 conn(0x7fd1ac10b6c0 0x7fd1ac19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 -- 172.21.15.73:0/3059132470 >> 172.21.15.73:0/3059132470 conn(0x7fd1ac1139f0 msgr2=0x7fd1ac0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 -- 172.21.15.73:0/3059132470 shutdown_connections 2024-03-24T10:39:42.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.686 7fd1b32cb700 1 -- 172.21.15.73:0/3059132470 wait complete. 2024-03-24T10:39:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.708 7fd1b32cb700 1 Processor -- start 2024-03-24T10:39:42.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 -- start start 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 0x7fd1ac0d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0ded10 0x7fd1ac0d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0efd80 con 0x7fd1ac0de8c0 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c3580 con 0x7fd1ac0ce190 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b32cb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ce8e0 con 0x7fd1ac0ded10 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1ab7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 0x7fd1ac0d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1b08c7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0ded10 0x7fd1ac0d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35512/0 (socket says 172.21.15.73:35512) 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1ab7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 0x7fd1ac0d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41234/0 (socket says 172.21.15.73:41234) 2024-03-24T10:39:42.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 -- 172.21.15.73:0/258615391 learned_addr learned my addr 172.21.15.73:0/258615391 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 -- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0ded10 msgr2=0x7fd1ac0d9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0ded10 0x7fd1ac0d9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 -- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 msgr2=0x7fd1ac0d9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 0x7fd1ac0d9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.709 7fd1abfff700 1 -- 172.21.15.73:0/258615391 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0e03b0 con 0x7fd1ac0ce190 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1abfff700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1ac0c47d0 tx=0x7fd1a000ed30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1ac0e03b0 con 0x7fd1ac0ce190 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000c940 con 0x7fd1ac0ce190 2024-03-24T10:39:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1a000f040 con 0x7fd1ac0ce190 2024-03-24T10:39:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0da070 con 0x7fd1ac0ce190 2024-03-24T10:39:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.710 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac1bb920 con 0x7fd1ac0ce190 2024-03-24T10:39:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.711 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd1a0011070 con 0x7fd1ac0ce190 2024-03-24T10:39:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.711 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd1a0010040 con 0x7fd1ac0ce190 2024-03-24T10:39:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.711 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac0f0860 con 0x7fd1ac0ce190 2024-03-24T10:39:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.714 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd1a000c540 con 0x7fd1ac0ce190 2024-03-24T10:39:42.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.819 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1ac0a61a0 con 0x7fd1ac0ce190 2024-03-24T10:39:42.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.820 7fd1a97fa700 1 -- 172.21.15.73:0/258615391 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1a0000c30 con 0x7fd1ac0ce190 2024-03-24T10:39:42.821 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 >> v1:172.21.15.73:6816/43277 conn(0x7fd18c0145b0 legacy=0x7fd18c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 msgr2=0x7fd1ac0de290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1ac0c47d0 tx=0x7fd1a000ed30).stop 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 shutdown_connections 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1ac0ded10 0x7fd1ac0d9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1ac0ce190 0x7fd1ac0de290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 --2- 172.21.15.73:0/258615391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1ac0de8c0 0x7fd1ac0d9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 >> 172.21.15.73:0/258615391 conn(0x7fd1ac0d2900 msgr2=0x7fd1ac1a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 shutdown_connections 2024-03-24T10:39:42.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.821 7fd1b32cb700 1 -- 172.21.15.73:0/258615391 wait complete. 2024-03-24T10:39:42.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 Processor -- start 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 -- start start 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 0x7fd53010b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd53010b6c0 0x7fd53019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5301a09f0 con 0x7fd53010bb10 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300fa510 con 0x7fd53010b6c0 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd535e53700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301a0c10 con 0x7fd5300f5990 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52e2b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd53010b6c0 0x7fd53019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52eab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 0x7fd53010b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52e2b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd53010b6c0 0x7fd53019fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41242/0 (socket says 172.21.15.73:41242) 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52eab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 0x7fd53010b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48512/0 (socket says 172.21.15.73:48512) 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52e2b1700 1 -- 172.21.15.73:0/1852876067 learned_addr learned my addr 172.21.15.73:0/1852876067 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.957 7fd52f2b3700 1 --1- 172.21.15.73:0/1852876067 >> v1:172.21.15.73:6789/0 conn(0x7fd53010bb10 0x7fd5301a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39810/0 (socket says 172.21.15.73:39810) 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52e2b1700 1 -- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 msgr2=0x7fd53010b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52e2b1700 1 --2- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 0x7fd53010b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52e2b1700 1 -- 172.21.15.73:0/1852876067 >> v1:172.21.15.73:6789/0 conn(0x7fd53010bb10 legacy=0x7fd5301a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52e2b1700 1 -- 172.21.15.73:0/1852876067 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5301a9350 con 0x7fd53010b6c0 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52dab0700 1 -- 172.21.15.73:0/1852876067 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775776315 0 0) 0x7fd528001110 con 0x7fd53010bb10 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52e2b1700 1 --2- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53010b6c0 0x7fd53019fbc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd524002f70 tx=0x7fd524009a50).ready entity=mon.0 client_cookie=ad10d484a39ffa83 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52dab0700 1 -- 172.21.15.73:0/1852876067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5301a9350 con 0x7fd53010b6c0 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52dab0700 1 -- 172.21.15.73:0/1852876067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400f510 con 0x7fd53010b6c0 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd52dab0700 1 -- 172.21.15.73:0/1852876067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd52400f6f0 con 0x7fd53010b6c0 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd535e53700 1 -- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53010b6c0 msgr2=0x7fd53019fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.958 7fd535e53700 1 --2- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53010b6c0 0x7fd53019fbc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd524002f70 tx=0x7fd524009a50).stop 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 -- 172.21.15.73:0/1852876067 shutdown_connections 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 --2- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300f5990 0x7fd53010b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 --2- 172.21.15.73:0/1852876067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53010b6c0 0x7fd53019fbc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 -- 172.21.15.73:0/1852876067 >> 172.21.15.73:0/1852876067 conn(0x7fd5301139f0 msgr2=0x7fd5300f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 -- 172.21.15.73:0/1852876067 shutdown_connections 2024-03-24T10:39:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.959 7fd535e53700 1 -- 172.21.15.73:0/1852876067 wait complete. 2024-03-24T10:39:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.981 7fd535e53700 1 Processor -- start 2024-03-24T10:39:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.981 7fd535e53700 1 -- start start 2024-03-24T10:39:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 0x7fd5300ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 0x7fd5301b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 0x7fd5301b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300e6520 con 0x7fd5300cee70 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300d5f70 con 0x7fd5300d6250 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301b0db0 con 0x7fd5300cea20 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52eab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 0x7fd5300ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52f2b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 0x7fd5301b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 0x7fd5301b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52eab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 0x7fd5300ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35524/0 (socket says 172.21.15.73:35524) 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52eab2700 1 -- 172.21.15.73:0/2799811277 learned_addr learned my addr 172.21.15.73:0/2799811277 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 -- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 msgr2=0x7fd5300ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 0x7fd5300ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 -- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 msgr2=0x7fd5301b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 0x7fd5301b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 -- 172.21.15.73:0/2799811277 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5301b0fb0 con 0x7fd5300cea20 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52f2b3700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 0x7fd5301b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd52e2b1700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 0x7fd5301b0150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5300c5eb0 tx=0x7fd5240068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5301b0fb0 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5240119c0 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd524011d90 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 -- 172.21.15.73:0/2799811277 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5301b78c0 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.982 7fd535e53700 1 -- 172.21.15.73:0/2799811277 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5301b7ca0 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.983 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd524019030 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.983 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd524018040 con 0x7fd5300cea20 2024-03-24T10:39:42.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.983 7fd535e53700 1 -- 172.21.15.73:0/2799811277 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5300f0860 con 0x7fd5300cea20 2024-03-24T10:39:42.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:42.986 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd5240117b0 con 0x7fd5300cea20 2024-03-24T10:39:43.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.092 7fd535e53700 1 -- 172.21.15.73:0/2799811277 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5300dd380 con 0x7fd5300cea20 2024-03-24T10:39:43.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.092 7fd51ffff700 1 -- 172.21.15.73:0/2799811277 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fd524037230 con 0x7fd5300cea20 2024-03-24T10:39:43.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:43.093 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.093 7fd535e53700 1 -- 172.21.15.73:0/2799811277 >> v1:172.21.15.73:6816/43277 conn(0x7fd50c0145b0 legacy=0x7fd50c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.093 7fd535e53700 1 -- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 msgr2=0x7fd5301b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.093 7fd535e53700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 0x7fd5301b0150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5300c5eb0 tx=0x7fd5240068c0).stop 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 -- 172.21.15.73:0/2799811277 shutdown_connections 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5300cee70 0x7fd5301b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5300d6250 0x7fd5300ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 --2- 172.21.15.73:0/2799811277 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5300cea20 0x7fd5301b0150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 -- 172.21.15.73:0/2799811277 >> 172.21.15.73:0/2799811277 conn(0x7fd5300c4b00 msgr2=0x7fd5301a4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 -- 172.21.15.73:0/2799811277 shutdown_connections 2024-03-24T10:39:43.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.094 7fd535e53700 1 -- 172.21.15.73:0/2799811277 wait complete. 2024-03-24T10:39:43.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:43.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 Processor -- start 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 -- start start 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 0x7fc3101a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3101a0a70 con 0x7fc31010b740 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3100fa590 con 0x7fc3100f5a10 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc317b6a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101a0c90 con 0x7fc31010bb90 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc314965700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc315166700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 0x7fc3101a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc314965700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41270/0 (socket says 172.21.15.73:41270) 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc314965700 1 -- 172.21.15.73:0/326542735 learned_addr learned my addr 172.21.15.73:0/326542735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc30ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc31010b740 0x7fc31019fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39824/0 (socket says 172.21.15.73:39824) 2024-03-24T10:39:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc315166700 1 -- 172.21.15.73:0/326542735 >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 msgr2=0x7fc31010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.234 7fc315166700 1 --2- 172.21.15.73:0/326542735 >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc315166700 1 -- 172.21.15.73:0/326542735 >> v1:172.21.15.73:6789/0 conn(0x7fc31010b740 legacy=0x7fc31019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc315166700 1 -- 172.21.15.73:0/326542735 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3101a93d0 con 0x7fc31010bb90 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc30f7fe700 1 -- 172.21.15.73:0/326542735 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472986496 0 0) 0x7fc2fc001110 con 0x7fc31010b740 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc314965700 1 --2- 172.21.15.73:0/326542735 >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc315166700 1 --2- 172.21.15.73:0/326542735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 0x7fc3101a0440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fc3100f47c0 tx=0x7fc308009cc0).ready entity=mon.1 client_cookie=bfb1e59c71ee468f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc30f7fe700 1 -- 172.21.15.73:0/326542735 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3101a93d0 con 0x7fc31010bb90 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc30f7fe700 1 -- 172.21.15.73:0/326542735 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800b840 con 0x7fc31010bb90 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc30f7fe700 1 -- 172.21.15.73:0/326542735 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30800ba20 con 0x7fc31010bb90 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 -- 172.21.15.73:0/326542735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 msgr2=0x7fc3101a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 --2- 172.21.15.73:0/326542735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 0x7fc3101a0440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fc3100f47c0 tx=0x7fc308009cc0).stop 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 -- 172.21.15.73:0/326542735 shutdown_connections 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 --2- 172.21.15.73:0/326542735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31010bb90 0x7fc3101a0440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 --2- 172.21.15.73:0/326542735 >> v2:172.21.15.73:3300/0 conn(0x7fc3100f5a10 0x7fc31010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 -- 172.21.15.73:0/326542735 >> 172.21.15.73:0/326542735 conn(0x7fc310113a70 msgr2=0x7fc3100f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 -- 172.21.15.73:0/326542735 shutdown_connections 2024-03-24T10:39:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.235 7fc317b6a700 1 -- 172.21.15.73:0/326542735 wait complete. 2024-03-24T10:39:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.258 7fc317b6a700 1 Processor -- start 2024-03-24T10:39:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.258 7fc317b6a700 1 -- start start 2024-03-24T10:39:43.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 0x7fc3101b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3101b2970 0x7fc3101b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100c4800 con 0x7fc3101ac4f0 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101b33f0 con 0x7fc3100d3f30 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc317b6a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100f2330 con 0x7fc3101b2970 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35550/0 (socket says 172.21.15.73:35550) 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 -- 172.21.15.73:0/3628548266 learned_addr learned my addr 172.21.15.73:0/3628548266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc30ffff700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 0x7fc3101b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc315166700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3101b2970 0x7fc3101b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 -- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3101b2970 msgr2=0x7fc3101b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3101b2970 0x7fc3101b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 -- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 msgr2=0x7fc3101b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 0x7fc3101b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 -- 172.21.15.73:0/3628548266 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100d4380 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc30ffff700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 0x7fc3101b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc314965700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc30400c000 tx=0x7fc30400ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3100d4380 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.259 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400ee10 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3101b9820 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30400f040 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3101b9c00 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc304011070 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc304010040 con 0x7fc3100d3f30 2024-03-24T10:39:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.260 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3100f08e0 con 0x7fc3100d3f30 2024-03-24T10:39:43.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.264 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc30400c5a0 con 0x7fc3100d3f30 2024-03-24T10:39:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.370 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3100c61a0 con 0x7fc3100d3f30 2024-03-24T10:39:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.370 7fc30dffb700 1 -- 172.21.15.73:0/3628548266 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc304000c30 con 0x7fc3100d3f30 2024-03-24T10:39:43.371 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.371 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 >> v1:172.21.15.73:6816/43277 conn(0x7fc2f80145b0 legacy=0x7fc2f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.371 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 msgr2=0x7fc3101abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc30400c000 tx=0x7fc30400ecd0).stop 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 shutdown_connections 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3101b2970 0x7fc3101b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3100d3f30 0x7fc3101abec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 --2- 172.21.15.73:0/3628548266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101ac4f0 0x7fc3101b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 >> 172.21.15.73:0/3628548266 conn(0x7fc3100c91f0 msgr2=0x7fc3100d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 shutdown_connections 2024-03-24T10:39:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.372 7fc317b6a700 1 -- 172.21.15.73:0/3628548266 wait complete. 2024-03-24T10:39:43.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:43.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 Processor -- start 2024-03-24T10:39:43.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 -- start start 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 0x7f3f081a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 0x7f3f081a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f081a1de0 con 0x7f3f080fb120 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080f2290 con 0x7f3f0810cf40 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0dc55700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08104e20 con 0x7f3f081a68b0 2024-03-24T10:39:43.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.511 7f3f0605c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 0x7f3f081a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0705e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 0x7f3f081a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0685d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f080fb120 0x7f3f0810c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39838/0 (socket says 172.21.15.73:39838) 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0685d700 1 -- 172.21.15.73:0/428797410 learned_addr learned my addr 172.21.15.73:0/428797410 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0585b700 1 -- 172.21.15.73:0/428797410 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596441330 0 0) 0x7f3ef0001110 con 0x7f3f080fb120 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0585b700 1 -- 172.21.15.73:0/428797410 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee8003270 con 0x7f3f080fb120 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0605c700 1 -- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 msgr2=0x7f3f081a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0605c700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 0x7f3f081a8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0605c700 1 -- 172.21.15.73:0/428797410 >> v1:172.21.15.73:6789/0 conn(0x7f3f080fb120 legacy=0x7f3f0810c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0605c700 1 -- 172.21.15.73:0/428797410 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f081aa350 con 0x7f3f0810cf40 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0705e700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 0x7f3f081a8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0605c700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 0x7f3f081a6280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3ef8002f70 tx=0x7f3ef800ba20).ready entity=mon.1 client_cookie=4095dd7edbab0ae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0585b700 1 -- 172.21.15.73:0/428797410 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f081aa350 con 0x7f3f0810cf40 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0585b700 1 -- 172.21.15.73:0/428797410 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800d570 con 0x7f3f0810cf40 2024-03-24T10:39:43.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0585b700 1 -- 172.21.15.73:0/428797410 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3ef800d940 con 0x7f3f0810cf40 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0dc55700 1 -- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 msgr2=0x7f3f081a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.512 7f3f0dc55700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 0x7f3f081a6280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3ef8002f70 tx=0x7f3ef800ba20).stop 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 -- 172.21.15.73:0/428797410 shutdown_connections 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081a68b0 0x7f3f081a8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 --2- 172.21.15.73:0/428797410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f0810cf40 0x7f3f081a6280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 -- 172.21.15.73:0/428797410 >> 172.21.15.73:0/428797410 conn(0x7f3f08114940 msgr2=0x7f3f08114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 -- 172.21.15.73:0/428797410 shutdown_connections 2024-03-24T10:39:43.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.513 7f3f0dc55700 1 -- 172.21.15.73:0/428797410 wait complete. 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 Processor -- start 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 -- start start 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 0x7f3f081b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 0x7f3f081b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080c4ea0 con 0x7f3f081ae210 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080e0ca0 con 0x7f3f080f4530 2024-03-24T10:39:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0dc55700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081b52e0 con 0x7f3f081ae660 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0685d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0705e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 0x7f3f081b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0685d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35568/0 (socket says 172.21.15.73:35568) 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0685d700 1 -- 172.21.15.73:0/1349124645 learned_addr learned my addr 172.21.15.73:0/1349124645 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.536 7f3f0605c700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 0x7f3f081b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 -- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 msgr2=0x7f3f081b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 0x7f3f081b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 -- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 msgr2=0x7f3f081b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 0x7f3f081b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 -- 172.21.15.73:0/1349124645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f081b5510 con 0x7f3f080f4530 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0605c700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 0x7f3f081b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0705e700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 0x7f3f081b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0685d700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3ef0000bc0 tx=0x7f3ef000c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f081b5510 con 0x7f3f080f4530 2024-03-24T10:39:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef00072e0 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f081bbdf0 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3ef0005810 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081bc1d0 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3ef0005a10 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.537 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3ef00149e0 con 0x7f3f080f4530 2024-03-24T10:39:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.538 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f080f08e0 con 0x7f3f080f4530 2024-03-24T10:39:43.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.541 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3ef00070d0 con 0x7f3f080f4530 2024-03-24T10:39:43.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.645 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f080f4980 con 0x7f3f080f4530 2024-03-24T10:39:43.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.645 7f3efffff700 1 -- 172.21.15.73:0/1349124645 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f081000d0 con 0x7f3f080f4530 2024-03-24T10:39:43.647 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 >> v1:172.21.15.73:6816/43277 conn(0x7f3eec0145b0 legacy=0x7f3eec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 msgr2=0x7f3f081adbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3ef0000bc0 tx=0x7f3ef000c7e0).stop 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 shutdown_connections 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3f081ae660 0x7f3f081b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3f080f4530 0x7f3f081adbe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 --2- 172.21.15.73:0/1349124645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f081ae210 0x7f3f081b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 >> 172.21.15.73:0/1349124645 conn(0x7f3f080c9560 msgr2=0x7f3f080d7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 shutdown_connections 2024-03-24T10:39:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.647 7f3f0dc55700 1 -- 172.21.15.73:0/1349124645 wait complete. 2024-03-24T10:39:43.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 Processor -- start 2024-03-24T10:39:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 -- start start 2024-03-24T10:39:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff780f91b0 con 0x7eff780f58a0 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff780f2460 con 0x7eff780f2010 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff7d8bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff781ac6a0 con 0x7eff781a8c00 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff75dc4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.787 7eff76dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35576/0 (socket says 172.21.15.73:35576) 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff75dc4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41290/0 (socket says 172.21.15.73:41290) 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 -- 172.21.15.73:0/1367293208 learned_addr learned my addr 172.21.15.73:0/1367293208 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff765c5700 1 --1- 172.21.15.73:0/1367293208 >> v1:172.21.15.73:6789/0 conn(0x7eff780f58a0 0x7eff780f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39852/0 (socket says 172.21.15.73:39852) 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 -- 172.21.15.73:0/1367293208 >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 msgr2=0x7eff781a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 --2- 172.21.15.73:0/1367293208 >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 -- 172.21.15.73:0/1367293208 >> v1:172.21.15.73:6789/0 conn(0x7eff780f58a0 legacy=0x7eff780f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 -- 172.21.15.73:0/1367293208 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff781ac850 con 0x7eff781a8c00 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff75dc4700 1 --2- 172.21.15.73:0/1367293208 >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff76dc6700 1 --2- 172.21.15.73:0/1367293208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7eff70002f70 tx=0x7eff700099d0).ready entity=mon.1 client_cookie=c9c9e78aa5dc2d02 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff755c3700 1 -- 172.21.15.73:0/1367293208 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7eff781ac850 con 0x7eff781a8c00 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff755c3700 1 -- 172.21.15.73:0/1367293208 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7000f510 con 0x7eff781a8c00 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff755c3700 1 -- 172.21.15.73:0/1367293208 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7eff7000f6f0 con 0x7eff781a8c00 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff7d8bd700 1 -- 172.21.15.73:0/1367293208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 msgr2=0x7eff781ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.788 7eff7d8bd700 1 --2- 172.21.15.73:0/1367293208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7eff70002f70 tx=0x7eff700099d0).stop 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 -- 172.21.15.73:0/1367293208 shutdown_connections 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 --2- 172.21.15.73:0/1367293208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781a8c00 0x7eff781ab060 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 --2- 172.21.15.73:0/1367293208 >> v2:172.21.15.73:3300/0 conn(0x7eff780f2010 0x7eff781a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 -- 172.21.15.73:0/1367293208 >> 172.21.15.73:0/1367293208 conn(0x7eff781139f0 msgr2=0x7eff780f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 -- 172.21.15.73:0/1367293208 shutdown_connections 2024-03-24T10:39:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.789 7eff7d8bd700 1 -- 172.21.15.73:0/1367293208 wait complete. 2024-03-24T10:39:43.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.811 7eff7d8bd700 1 Processor -- start 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.811 7eff7d8bd700 1 -- start start 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.811 7eff7d8bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.811 7eff7d8bd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7eff781b4290 0x7eff781b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 0x7eff781bb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff780a2570 con 0x7eff780cb880 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780d2b00 con 0x7eff781b4d10 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff780c5790 con 0x7eff781b4290 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41304/0 (socket says 172.21.15.73:41304) 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 -- 172.21.15.73:0/3123965819 learned_addr learned my addr 172.21.15.73:0/3123965819 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff76dc6700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 0x7eff781bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff75dc4700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7eff781b4290 0x7eff781b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 -- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7eff781b4290 msgr2=0x7eff781b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7eff781b4290 0x7eff781b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 -- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 msgr2=0x7eff781bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 0x7eff781bb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 -- 172.21.15.73:0/3123965819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff781b5160 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff76dc6700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 0x7eff781bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff765c5700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff780c07b0 tx=0x7eff6800cbf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7eff781b5160 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff680058e0 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff780c4f20 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7eff68005cb0 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.812 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff781bbf80 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.813 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7eff6801a020 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.813 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7eff68009d90 con 0x7eff780cb880 2024-03-24T10:39:43.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.813 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff780f0860 con 0x7eff780cb880 2024-03-24T10:39:43.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.817 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7eff6800cd30 con 0x7eff780cb880 2024-03-24T10:39:43.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.921 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff780eff30 con 0x7eff780cb880 2024-03-24T10:39:43.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.922 7eff6f7fe700 1 -- 172.21.15.73:0/3123965819 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff68000fb0 con 0x7eff780cb880 2024-03-24T10:39:43.923 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 >> v1:172.21.15.73:6816/43277 conn(0x7eff5c0145b0 legacy=0x7eff5c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 msgr2=0x7eff780cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff780c07b0 tx=0x7eff6800cbf0).stop 2024-03-24T10:39:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 shutdown_connections 2024-03-24T10:39:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff781b4d10 0x7eff781bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff780cb880 0x7eff780cbcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 --2- 172.21.15.73:0/3123965819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7eff781b4290 0x7eff781b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:43.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 >> 172.21.15.73:0/3123965819 conn(0x7eff780bd480 msgr2=0x7eff780c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:43.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 shutdown_connections 2024-03-24T10:39:43.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:43.923 7eff7d8bd700 1 -- 172.21.15.73:0/3123965819 wait complete. 2024-03-24T10:39:43.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:44.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.058 7fbaac153700 1 Processor -- start 2024-03-24T10:39:44.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.058 7fbaac153700 1 -- start start 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaac153700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 0x7fbaa40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaac153700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaac153700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40f9230 con 0x7fbaa40f2310 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaac153700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa410f0e0 con 0x7fbaa40f1ec0 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaac153700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41ac680 con 0x7fbaa40f5920 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 0x7fbaa40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa974f700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbaa40f2310 0x7fbaa410e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39854/0 (socket says 172.21.15.73:39854) 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa974f700 1 -- 172.21.15.73:0/834452972 learned_addr learned my addr 172.21.15.73:0/834452972 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa3fff700 1 --2- 172.21.15.73:0/834452972 >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41316/0 (socket says 172.21.15.73:41316) 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 -- 172.21.15.73:0/834452972 >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 msgr2=0x7fbaa410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 --2- 172.21.15.73:0/834452972 >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 -- 172.21.15.73:0/834452972 >> v1:172.21.15.73:6789/0 conn(0x7fbaa40f2310 legacy=0x7fbaa410e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 -- 172.21.15.73:0/834452972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa41ac830 con 0x7fbaa40f5920 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa3fff700 1 --2- 172.21.15.73:0/834452972 >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa8f4e700 1 --2- 172.21.15.73:0/834452972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 0x7fbaa40f1890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fba98002f70 tx=0x7fba9800b970).ready entity=mon.1 client_cookie=80cb2c87328643ad server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa37fe700 1 -- 172.21.15.73:0/834452972 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbaa41ac830 con 0x7fbaa40f5920 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa37fe700 1 -- 172.21.15.73:0/834452972 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800d5c0 con 0x7fbaa40f5920 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.059 7fbaa37fe700 1 -- 172.21.15.73:0/834452972 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba9800d990 con 0x7fbaa40f5920 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 -- 172.21.15.73:0/834452972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 msgr2=0x7fbaa40f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 --2- 172.21.15.73:0/834452972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 0x7fbaa40f1890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fba98002f70 tx=0x7fba9800b970).stop 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 -- 172.21.15.73:0/834452972 shutdown_connections 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 --2- 172.21.15.73:0/834452972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa40f5920 0x7fbaa40f1890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 --2- 172.21.15.73:0/834452972 >> v2:172.21.15.73:3300/0 conn(0x7fbaa40f1ec0 0x7fbaa410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 -- 172.21.15.73:0/834452972 >> 172.21.15.73:0/834452972 conn(0x7fbaa4113a70 msgr2=0x7fbaa40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 -- 172.21.15.73:0/834452972 shutdown_connections 2024-03-24T10:39:44.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.060 7fbaac153700 1 -- 172.21.15.73:0/834452972 wait complete. 2024-03-24T10:39:44.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 Processor -- start 2024-03-24T10:39:44.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 -- start start 2024-03-24T10:39:44.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 0x7fbaa40d7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40cf130 con 0x7fbaa40d7340 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40c3ad0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaac153700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40c4100 con 0x7fbaa40d7dc0 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa974f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa8f4e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 0x7fbaa40d7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48562/0 (socket says 172.21.15.73:48562) 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa3fff700 1 -- 172.21.15.73:0/3120303409 learned_addr learned my addr 172.21.15.73:0/3120303409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.083 7fbaa974f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35602/0 (socket says 172.21.15.73:35602) 2024-03-24T10:39:44.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 -- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 msgr2=0x7fbaa41b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 -- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 msgr2=0x7fbaa40d7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 0x7fbaa40d7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 -- 172.21.15.73:0/3120303409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40cf6c0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa3fff700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa8f4e700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 0x7fbaa40d7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa974f700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbaa40bdba0 tx=0x7fba9c00c990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbaa40cf6c0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c005bb0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba9c0048b0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.084 7fbaac153700 1 -- 172.21.15.73:0/3120303409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa40c49a0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.085 7fbaac153700 1 -- 172.21.15.73:0/3120303409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa41b5510 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.085 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fba9c004ab0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.085 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fba9c00b960 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.085 7fbaac153700 1 -- 172.21.15.73:0/3120303409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40f08e0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.089 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fba9c0059a0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.196 7fbaac153700 1 -- 172.21.15.73:0/3120303409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa40e2430 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.196 7fbaa1ffb700 1 -- 172.21.15.73:0/3120303409 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fbaa41145f0 con 0x7fbaa41b4ee0 2024-03-24T10:39:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:44.197 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:44.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.197 7fbaac153700 1 -- 172.21.15.73:0/3120303409 >> v1:172.21.15.73:6816/43277 conn(0x7fba8c0145b0 legacy=0x7fba8c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.197 7fbaac153700 1 -- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 msgr2=0x7fbaa41bbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.197 7fbaac153700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbaa40bdba0 tx=0x7fba9c00c990).stop 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 -- 172.21.15.73:0/3120303409 shutdown_connections 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbaa41b4ee0 0x7fbaa41bbd10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbaa40d7340 0x7fbaa40d7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 --2- 172.21.15.73:0/3120303409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fbaa40d7dc0 0x7fbaa41b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 -- 172.21.15.73:0/3120303409 >> 172.21.15.73:0/3120303409 conn(0x7fbaa40dc8f0 msgr2=0x7fbaa40d8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 -- 172.21.15.73:0/3120303409 shutdown_connections 2024-03-24T10:39:44.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.198 7fbaac153700 1 -- 172.21.15.73:0/3120303409 wait complete. 2024-03-24T10:39:44.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:44.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 Processor -- start 2024-03-24T10:39:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 -- start start 2024-03-24T10:39:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c80f5a10 0x7fc7c810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c81a0a70 con 0x7fc7c810b740 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c80fa590 con 0x7fc7c80f5a10 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7d011c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81a0c90 con 0x7fc7c810bb90 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7cd718700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7ccf17700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c80f5a10 0x7fc7c810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7cd718700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35614/0 (socket says 172.21.15.73:35614) 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7cd718700 1 -- 172.21.15.73:0/3937509979 learned_addr learned my addr 172.21.15.73:0/3937509979 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.336 7fc7bffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7c810b740 0x7fc7c819fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39870/0 (socket says 172.21.15.73:39870) 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7bf7fe700 1 -- 172.21.15.73:0/3937509979 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414441750 0 0) 0x7fc7b8001110 con 0x7fc7c810b740 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7bf7fe700 1 -- 172.21.15.73:0/3937509979 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003270 con 0x7fc7c810b740 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7ccf17700 1 -- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 msgr2=0x7fc7c81a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7ccf17700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7ccf17700 1 -- 172.21.15.73:0/3937509979 >> v1:172.21.15.73:6789/0 conn(0x7fc7c810b740 legacy=0x7fc7c819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7ccf17700 1 -- 172.21.15.73:0/3937509979 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c81a93d0 con 0x7fc7c80f5a10 2024-03-24T10:39:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7cd718700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7ccf17700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80f5a10 0x7fc7c810b110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc7c8103a10 tx=0x7fc7c400ba20).ready entity=mon.0 client_cookie=9e0c373defd2751 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7bf7fe700 1 -- 172.21.15.73:0/3937509979 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7c81a93d0 con 0x7fc7c80f5a10 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7bf7fe700 1 -- 172.21.15.73:0/3937509979 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400d5c0 con 0x7fc7c80f5a10 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7bf7fe700 1 -- 172.21.15.73:0/3937509979 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7c400d990 con 0x7fc7c80f5a10 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7d011c700 1 -- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80f5a10 msgr2=0x7fc7c810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.337 7fc7d011c700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80f5a10 0x7fc7c810b110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc7c8103a10 tx=0x7fc7c400ba20).stop 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 -- 172.21.15.73:0/3937509979 shutdown_connections 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c810bb90 0x7fc7c81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 --2- 172.21.15.73:0/3937509979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80f5a10 0x7fc7c810b110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 -- 172.21.15.73:0/3937509979 >> 172.21.15.73:0/3937509979 conn(0x7fc7c8113a70 msgr2=0x7fc7c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 -- 172.21.15.73:0/3937509979 shutdown_connections 2024-03-24T10:39:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.338 7fc7d011c700 1 -- 172.21.15.73:0/3937509979 wait complete. 2024-03-24T10:39:44.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.360 7fc7d011c700 1 Processor -- start 2024-03-24T10:39:44.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.360 7fc7d011c700 1 -- start start 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 0x7fc7c81ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 0x7fc7c80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8088fe0 con 0x7fc7c81ae640 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80c5ec0 con 0x7fc7c80c7c90 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7d011c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81a5db0 con 0x7fc7c81adbc0 2024-03-24T10:39:44.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7ccf17700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 0x7fc7c81ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 0x7fc7c80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35628/0 (socket says 172.21.15.73:35628) 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 0x7fc7c80c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41342/0 (socket says 172.21.15.73:41342) 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7ccf17700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 0x7fc7c81ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48576/0 (socket says 172.21.15.73:48576) 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 -- 172.21.15.73:0/132365631 learned_addr learned my addr 172.21.15.73:0/132365631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 -- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 msgr2=0x7fc7c81ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 0x7fc7c81ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 -- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 msgr2=0x7fc7c80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 0x7fc7c80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.361 7fc7cd718700 1 -- 172.21.15.73:0/132365631 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c81a5af0 con 0x7fc7c80c7c90 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7cd718700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc7c000c000 tx=0x7fc7c000ee00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7c81a5af0 con 0x7fc7c80c7c90 2024-03-24T10:39:44.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c000c950 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7d011c700 1 -- 172.21.15.73:0/132365631 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c81a5740 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7c000f040 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7d011c700 1 -- 172.21.15.73:0/132365631 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c81bbf70 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc7c0011070 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.362 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc7c0010040 con 0x7fc7c80c7c90 2024-03-24T10:39:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.363 7fc7d011c700 1 -- 172.21.15.73:0/132365631 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c80f08e0 con 0x7fc7c80c7c90 2024-03-24T10:39:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.366 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc7c000c740 con 0x7fc7c80c7c90 2024-03-24T10:39:44.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.471 7fc7d011c700 1 -- 172.21.15.73:0/132365631 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7c80e2430 con 0x7fc7c80c7c90 2024-03-24T10:39:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.471 7fc7bdffb700 1 -- 172.21.15.73:0/132365631 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7c81145f0 con 0x7fc7c80c7c90 2024-03-24T10:39:44.473 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 >> v1:172.21.15.73:6816/43277 conn(0x7fc7a80145b0 legacy=0x7fc7a8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 msgr2=0x7fc7c80c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc7c000c000 tx=0x7fc7c000ee00).stop 2024-03-24T10:39:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 shutdown_connections 2024-03-24T10:39:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7c80c7c90 0x7fc7c80c80e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc7c81adbc0 0x7fc7c81ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 --2- 172.21.15.73:0/132365631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c81ae640 0x7fc7c80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 >> 172.21.15.73:0/132365631 conn(0x7fc7c80c71a0 msgr2=0x7fc7c80d85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 shutdown_connections 2024-03-24T10:39:44.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.473 7fc7d011c700 1 -- 172.21.15.73:0/132365631 wait complete. 2024-03-24T10:39:44.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:44.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 Processor -- start 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 -- start start 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 0x7f4dd810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 0x7f4dd80f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd80f26c0 con 0x7f4dd810c970 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd80fa290 con 0x7f4dd80f5920 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.611 7f4ddd9eb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd80f95c0 con 0x7f4dd810cdc0 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd6fd9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 0x7f4dd80f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 0x7f4dd810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd5fd7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4dd810c970 0x7f4dd80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39878/0 (socket says 172.21.15.73:39878) 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd5fd7700 1 -- 172.21.15.73:0/1056726344 learned_addr learned my addr 172.21.15.73:0/1056726344 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 -- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 msgr2=0x7f4dd80f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 0x7f4dd80f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd57d6700 1 -- 172.21.15.73:0/1056726344 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952549598 0 0) 0x7f4dc8001110 con 0x7f4dd810c970 2024-03-24T10:39:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 -- 172.21.15.73:0/1056726344 >> v1:172.21.15.73:6789/0 conn(0x7f4dd810c970 legacy=0x7f4dd80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 -- 172.21.15.73:0/1056726344 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd81aa5e0 con 0x7f4dd80f5920 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd6fd9700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 0x7f4dd80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd67d8700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 0x7f4dd810c340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4dd80f6350 tx=0x7f4dcc00ba50).ready entity=mon.1 client_cookie=993ff96f89249178 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd57d6700 1 -- 172.21.15.73:0/1056726344 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd81aa5e0 con 0x7f4dd80f5920 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd57d6700 1 -- 172.21.15.73:0/1056726344 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00d570 con 0x7f4dd80f5920 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4dd57d6700 1 -- 172.21.15.73:0/1056726344 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dcc00d940 con 0x7f4dd80f5920 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4ddd9eb700 1 -- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 msgr2=0x7f4dd810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.612 7f4ddd9eb700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 0x7f4dd810c340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4dd80f6350 tx=0x7f4dcc00ba50).stop 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 -- 172.21.15.73:0/1056726344 shutdown_connections 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd810cdc0 0x7f4dd80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 --2- 172.21.15.73:0/1056726344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80f5920 0x7f4dd810c340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 -- 172.21.15.73:0/1056726344 >> 172.21.15.73:0/1056726344 conn(0x7f4dd8113a70 msgr2=0x7f4dd80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 -- 172.21.15.73:0/1056726344 shutdown_connections 2024-03-24T10:39:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.613 7f4ddd9eb700 1 -- 172.21.15.73:0/1056726344 wait complete. 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.635 7f4ddd9eb700 1 Processor -- start 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 -- start start 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 0x7f4dd81b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd80e09b0 con 0x7f4dd81b2640 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd80c4d50 con 0x7f4dd80cae60 2024-03-24T10:39:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4ddd9eb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81b3510 con 0x7f4dd81b30c0 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd67d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd67d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35642/0 (socket says 172.21.15.73:35642) 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41354/0 (socket says 172.21.15.73:41354) 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd67d8700 1 -- 172.21.15.73:0/1877961990 learned_addr learned my addr 172.21.15.73:0/1877961990 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd6fd9700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 0x7f4dd81b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 -- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 msgr2=0x7f4dd81b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 0x7f4dd81b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 -- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 msgr2=0x7f4dd80cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 -- 172.21.15.73:0/1877961990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd80db910 con 0x7f4dd81b2640 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd67d8700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd6fd9700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 0x7f4dd81b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.636 7f4dd5fd7700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4dd80c5590 tx=0x7f4dc800c800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd80db910 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc80070d0 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd80cb8e0 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dc8005620 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd81ba330 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4dc8005820 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.637 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4dc8014800 con 0x7f4dd81b2640 2024-03-24T10:39:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.638 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd80f08e0 con 0x7f4dd81b2640 2024-03-24T10:39:44.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.641 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4dc800cdb0 con 0x7f4dd81b2640 2024-03-24T10:39:44.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.747 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4dd81acd60 con 0x7f4dd81b2640 2024-03-24T10:39:44.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.747 7f4dc77fe700 1 -- 172.21.15.73:0/1877961990 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4dc8000c30 con 0x7f4dd81b2640 2024-03-24T10:39:44.748 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 >> v1:172.21.15.73:6816/43277 conn(0x7f4db40145b0 legacy=0x7f4db4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 msgr2=0x7f4dd81b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4dd80c5590 tx=0x7f4dc800c800).stop 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 shutdown_connections 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd81b30c0 0x7f4dd81b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd80cae60 0x7f4dd80cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 --2- 172.21.15.73:0/1877961990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd81b2640 0x7f4dd81b2a90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 >> 172.21.15.73:0/1877961990 conn(0x7f4dd80cfd00 msgr2=0x7f4dd80d7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 shutdown_connections 2024-03-24T10:39:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.748 7f4ddd9eb700 1 -- 172.21.15.73:0/1877961990 wait complete. 2024-03-24T10:39:44.760 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:44.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.886 7f5f22922700 1 Processor -- start 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.886 7f5f22922700 1 -- start start 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f22922700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f1c0f5920 0x7f5f1c10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f22922700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f22922700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c0f26c0 con 0x7f5f1c10cdc0 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f22922700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0fa290 con 0x7f5f1c0f5920 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f22922700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0f95c0 con 0x7f5f1c10c970 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f1c0f5920 0x7f5f1c10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1adea700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f1c0f5920 0x7f5f1c10c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41356/0 (socket says 172.21.15.73:41356) 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1bdec700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5f1c10cdc0 0x7f5f1c0f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39894/0 (socket says 172.21.15.73:39894) 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 -- 172.21.15.73:0/756448165 learned_addr learned my addr 172.21.15.73:0/756448165 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1adea700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48620/0 (socket says 172.21.15.73:48620) 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 -- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 msgr2=0x7f5f1c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 -- 172.21.15.73:0/756448165 >> v1:172.21.15.73:6789/0 conn(0x7f5f1c10cdc0 legacy=0x7f5f1c0f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1a5e9700 1 -- 172.21.15.73:0/756448165 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186022766 0 0) 0x7f5f14001490 con 0x7f5f1c10cdc0 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 -- 172.21.15.73:0/756448165 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c1aa5e0 con 0x7f5f1c0f5920 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1adea700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1b5eb700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0f5920 0x7f5f1c10c340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5f1c0f9770 tx=0x7f5f10009a80).ready entity=mon.0 client_cookie=9052168f394811ea server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.887 7f5f1a5e9700 1 -- 172.21.15.73:0/756448165 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f1c1aa5e0 con 0x7f5f1c0f5920 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f1a5e9700 1 -- 172.21.15.73:0/756448165 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000f510 con 0x7f5f1c0f5920 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f1a5e9700 1 -- 172.21.15.73:0/756448165 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f1000f740 con 0x7f5f1c0f5920 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 -- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0f5920 msgr2=0x7f5f1c10c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0f5920 0x7f5f1c10c340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5f1c0f9770 tx=0x7f5f10009a80).stop 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 -- 172.21.15.73:0/756448165 shutdown_connections 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0f5920 0x7f5f1c10c340 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 --2- 172.21.15.73:0/756448165 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c10c970 0x7f5f1c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 -- 172.21.15.73:0/756448165 >> 172.21.15.73:0/756448165 conn(0x7f5f1c113a70 msgr2=0x7f5f1c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 -- 172.21.15.73:0/756448165 shutdown_connections 2024-03-24T10:39:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.888 7f5f22922700 1 -- 172.21.15.73:0/756448165 wait complete. 2024-03-24T10:39:44.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.910 7f5f22922700 1 Processor -- start 2024-03-24T10:39:44.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 -- start start 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 0x7f5f1c1b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0ddfb0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0e0a30 con 0x7f5f1c0c9a80 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f22922700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0cab50 con 0x7f5f1c1ac250 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1b5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1bdec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 0x7f5f1c1b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:44.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1b5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35646/0 (socket says 172.21.15.73:35646) 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41366/0 (socket says 172.21.15.73:41366) 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1b5eb700 1 -- 172.21.15.73:0/369046553 learned_addr learned my addr 172.21.15.73:0/369046553 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 -- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 msgr2=0x7f5f1c1b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 0x7f5f1c1b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 -- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 msgr2=0x7f5f1c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1adea700 1 -- 172.21.15.73:0/369046553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c1ac6a0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1bdec700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 0x7f5f1c1b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.911 7f5f1b5eb700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f1adea700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5f0c00c000 tx=0x7f5f0c00eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f1c1ac6a0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00c790 con 0x7f5f1c0ca500 2024-03-24T10:39:44.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f22922700 1 -- 172.21.15.73:0/369046553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c1ac9c0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f0c00f040 con 0x7f5f1c0ca500 2024-03-24T10:39:44.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f22922700 1 -- 172.21.15.73:0/369046553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c1ba5a0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5f0c011070 con 0x7f5f1c0ca500 2024-03-24T10:39:44.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.912 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5f0c010040 con 0x7f5f1c0ca500 2024-03-24T10:39:44.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.913 7f5f22922700 1 -- 172.21.15.73:0/369046553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c0f08e0 con 0x7f5f1c0ca500 2024-03-24T10:39:44.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:44.916 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5f0c00cb60 con 0x7f5f1c0ca500 2024-03-24T10:39:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.020 7f5f22922700 1 -- 172.21.15.73:0/369046553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f1c0c61a0 con 0x7f5f1c0ca500 2024-03-24T10:39:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.020 7f5f18de6700 1 -- 172.21.15.73:0/369046553 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f0c000c30 con 0x7f5f1c0ca500 2024-03-24T10:39:45.022 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.021 7f5f22922700 1 -- 172.21.15.73:0/369046553 >> v1:172.21.15.73:6816/43277 conn(0x7f5efc0145b0 legacy=0x7f5efc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.021 7f5f22922700 1 -- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 msgr2=0x7f5f1c1abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.021 7f5f22922700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5f0c00c000 tx=0x7f5f0c00eca0).stop 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 -- 172.21.15.73:0/369046553 shutdown_connections 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5f1c1ac250 0x7f5f1c1b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f1c0c9a80 0x7f5f1c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 --2- 172.21.15.73:0/369046553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1c0ca500 0x7f5f1c1abc20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 -- 172.21.15.73:0/369046553 >> 172.21.15.73:0/369046553 conn(0x7f5f1c0c9210 msgr2=0x7f5f1c1a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 -- 172.21.15.73:0/369046553 shutdown_connections 2024-03-24T10:39:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.022 7f5f22922700 1 -- 172.21.15.73:0/369046553 wait complete. 2024-03-24T10:39:45.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:45.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.158 7ffab477b700 1 Processor -- start 2024-03-24T10:39:45.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.158 7ffab477b700 1 -- start start 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac0fa590 con 0x7ffaac0f5a10 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1a08a0 con 0x7ffaac10bb90 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab477b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1a0ad0 con 0x7ffaac10b740 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1d77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1576700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1d77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35658/0 (socket says 172.21.15.73:35658) 2024-03-24T10:39:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1576700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41374/0 (socket says 172.21.15.73:41374) 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48638/0 (socket says 172.21.15.73:48638) 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1d77700 1 -- 172.21.15.73:0/1320129505 learned_addr learned my addr 172.21.15.73:0/1320129505 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 -- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 msgr2=0x7ffaac1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 -- 172.21.15.73:0/1320129505 >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 msgr2=0x7ffaac10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 --2- 172.21.15.73:0/1320129505 >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 -- 172.21.15.73:0/1320129505 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac1a73b0 con 0x7ffaac10b740 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1576700 1 --2- 172.21.15.73:0/1320129505 >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab1d77700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.159 7ffab0d75700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffaac0f47c0 tx=0x7ffaa800b9a0).ready entity=mon.2 client_cookie=411bdf98157ab352 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffa9bfff700 1 -- 172.21.15.73:0/1320129505 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaac1a73b0 con 0x7ffaac10b740 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffa9bfff700 1 -- 172.21.15.73:0/1320129505 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800d570 con 0x7ffaac10b740 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffa9bfff700 1 -- 172.21.15.73:0/1320129505 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaa800d940 con 0x7ffaac10b740 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 -- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 msgr2=0x7ffaac19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffaac0f47c0 tx=0x7ffaa800b9a0).stop 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 -- 172.21.15.73:0/1320129505 shutdown_connections 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac10bb90 0x7ffaac1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 --2- 172.21.15.73:0/1320129505 >> v2:172.21.15.73:3300/0 conn(0x7ffaac0f5a10 0x7ffaac10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 --2- 172.21.15.73:0/1320129505 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac10b740 0x7ffaac19fc40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 -- 172.21.15.73:0/1320129505 >> 172.21.15.73:0/1320129505 conn(0x7ffaac113a70 msgr2=0x7ffaac0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 -- 172.21.15.73:0/1320129505 shutdown_connections 2024-03-24T10:39:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.160 7ffab477b700 1 -- 172.21.15.73:0/1320129505 wait complete. 2024-03-24T10:39:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 Processor -- start 2024-03-24T10:39:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 -- start start 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 0x7ffaac1b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 0x7ffaac1b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0de330 con 0x7ffaac0da500 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1a11c0 con 0x7ffaac0da0b0 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab477b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0f1db0 con 0x7ffaac1a1790 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab1576700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab0d75700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 0x7ffaac1b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab1d77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 0x7ffaac1b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab1576700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48650/0 (socket says 172.21.15.73:48650) 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.185 7ffab1576700 1 -- 172.21.15.73:0/4179868866 learned_addr learned my addr 172.21.15.73:0/4179868866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 -- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 msgr2=0x7ffaac0d9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 -- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 msgr2=0x7ffaac1b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 0x7ffaac1b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 -- 172.21.15.73:0/4179868866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac1b5400 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1576700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab0d75700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 0x7ffaac1b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab1d77700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 0x7ffaac1b4dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ffaac0de4e0 tx=0x7ffaa400edd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaac1b5400 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400c750 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffaa400f040 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab477b700 1 -- 172.21.15.73:0/4179868866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac1b5720 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffab477b700 1 -- 172.21.15.73:0/4179868866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1bc070 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ffaa4011070 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.186 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ffaa4010040 con 0x7ffaac0da500 2024-03-24T10:39:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.187 7ffab477b700 1 -- 172.21.15.73:0/4179868866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac0da950 con 0x7ffaac0da500 2024-03-24T10:39:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.190 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ffaa400c540 con 0x7ffaac0da500 2024-03-24T10:39:45.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.296 7ffab477b700 1 -- 172.21.15.73:0/4179868866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaac0f08e0 con 0x7ffaac0da500 2024-03-24T10:39:45.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.297 7ffa9a7fc700 1 -- 172.21.15.73:0/4179868866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7ffaac1145f0 con 0x7ffaac0da500 2024-03-24T10:39:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:45.298 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 >> v1:172.21.15.73:6816/43277 conn(0x7ffa8c0145b0 legacy=0x7ffa8c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 msgr2=0x7ffaac1b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 0x7ffaac1b4dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ffaac0de4e0 tx=0x7ffaa400edd0).stop 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 shutdown_connections 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0da500 0x7ffaac1b4dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffaac1a1790 0x7ffaac0d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 --2- 172.21.15.73:0/4179868866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffaac0da0b0 0x7ffaac1b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 >> 172.21.15.73:0/4179868866 conn(0x7ffaac0f1890 msgr2=0x7ffaac0d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 shutdown_connections 2024-03-24T10:39:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.298 7ffab477b700 1 -- 172.21.15.73:0/4179868866 wait complete. 2024-03-24T10:39:45.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:45.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:45.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.437 7f6b21bdb700 1 Processor -- start 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.437 7f6b21bdb700 1 -- start start 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b21bdb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b21bdb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 0x7f6b1c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b21bdb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c1a0a70 con 0x7f6b1c10b740 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b21bdb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0fa590 con 0x7f6b1c0f5a10 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b21bdb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1a0c90 con 0x7f6b1c10bb90 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1a85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 0x7f6b1c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1a05c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6b1c10b740 0x7f6b1c19fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39904/0 (socket says 172.21.15.73:39904) 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1a05c700 1 -- 172.21.15.73:0/377894291 learned_addr learned my addr 172.21.15.73:0/377894291 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1a85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35684/0 (socket says 172.21.15.73:35684) 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 -- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 msgr2=0x7f6b1c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 -- 172.21.15.73:0/377894291 >> v1:172.21.15.73:6789/0 conn(0x7f6b1c10b740 legacy=0x7f6b1c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1985b700 1 -- 172.21.15.73:0/377894291 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863875686 0 0) 0x7f6b0c001110 con 0x7f6b1c10b740 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 -- 172.21.15.73:0/377894291 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c1a93d0 con 0x7f6b1c10bb90 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1a85d700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.438 7f6b1b05e700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 0x7f6b1c1a0440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6b1c0f47c0 tx=0x7f6b14009cf0).ready entity=mon.2 client_cookie=695671992f1fd585 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b1985b700 1 -- 172.21.15.73:0/377894291 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1c1a93d0 con 0x7f6b1c10bb90 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b1985b700 1 -- 172.21.15.73:0/377894291 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1400b840 con 0x7f6b1c10bb90 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b1985b700 1 -- 172.21.15.73:0/377894291 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1400ba20 con 0x7f6b1c10bb90 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 -- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 msgr2=0x7f6b1c1a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 0x7f6b1c1a0440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6b1c0f47c0 tx=0x7f6b14009cf0).stop 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 -- 172.21.15.73:0/377894291 shutdown_connections 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c10bb90 0x7f6b1c1a0440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 --2- 172.21.15.73:0/377894291 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0f5a10 0x7f6b1c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 -- 172.21.15.73:0/377894291 >> 172.21.15.73:0/377894291 conn(0x7f6b1c113a70 msgr2=0x7f6b1c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 -- 172.21.15.73:0/377894291 shutdown_connections 2024-03-24T10:39:45.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.439 7f6b21bdb700 1 -- 172.21.15.73:0/377894291 wait complete. 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 Processor -- start 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 -- start start 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 0x7f6b1c1b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 0x7f6b1c1b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0df940 con 0x7f6b1c1b0c70 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1b1510 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b21bdb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0ded80 con 0x7f6b1c1b10c0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.462 7f6b1a85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a05c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 0x7f6b1c1b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1b05e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 0x7f6b1c1b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35686/0 (socket says 172.21.15.73:35686) 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 -- 172.21.15.73:0/1468555528 learned_addr learned my addr 172.21.15.73:0/1468555528 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 -- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 msgr2=0x7f6b1c1b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 0x7f6b1c1b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 -- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 msgr2=0x7f6b1c1b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 0x7f6b1c1b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 -- 172.21.15.73:0/1468555528 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c1b5830 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1b05e700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 0x7f6b1c1b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a05c700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 0x7f6b1c1b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b1a85d700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6b1c0d8d00 tx=0x7f6b1000bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1c1b5830 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000c9a0 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1000f040 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c1b5b50 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.463 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c1bc4a0 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.464 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6b10011070 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.464 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f6b10010040 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.464 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c0f08e0 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.467 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f6b1000c5a0 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.573 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b1c0e0560 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.574 7f6b0bfff700 1 -- 172.21.15.73:0/1468555528 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b10000c30 con 0x7f6b1c0df3b0 2024-03-24T10:39:45.575 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 >> v1:172.21.15.73:6816/43277 conn(0x7f6af80145b0 legacy=0x7f6af8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 msgr2=0x7f6b1c1b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6b1c0d8d00 tx=0x7f6b1000bf70).stop 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 shutdown_connections 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f6b1c1b10c0 0x7f6b1c1b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6b1c0df3b0 0x7f6b1c1b0640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 --2- 172.21.15.73:0/1468555528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b1c1b0c70 0x7f6b1c1b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 >> 172.21.15.73:0/1468555528 conn(0x7f6b1c0c6c70 msgr2=0x7f6b1c0d7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 shutdown_connections 2024-03-24T10:39:45.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.575 7f6b21bdb700 1 -- 172.21.15.73:0/1468555528 wait complete. 2024-03-24T10:39:45.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.713 7fae548a2700 1 Processor -- start 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.713 7fae548a2700 1 -- start start 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 0x7fae501a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500fa590 con 0x7fae5010b740 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae501a08a0 con 0x7fae500f5a10 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae501a0ad0 con 0x7fae5010bb90 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae44dfa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 0x7fae501a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35700/0 (socket says 172.21.15.73:35700) 2024-03-24T10:39:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae44dfa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41404/0 (socket says 172.21.15.73:41404) 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4d5fb700 1 -- 172.21.15.73:0/2957259213 learned_addr learned my addr 172.21.15.73:0/2957259213 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 -- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 msgr2=0x7fae5010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 -- 172.21.15.73:0/2957259213 >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 msgr2=0x7fae5019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 --2- 172.21.15.73:0/2957259213 >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 -- 172.21.15.73:0/2957259213 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae501a73b0 con 0x7fae5010bb90 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4d5fb700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae44dfa700 1 --2- 172.21.15.73:0/2957259213 >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4ddfc700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 0x7fae501a0270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fae500f47c0 tx=0x7fae48009cc0).ready entity=mon.2 client_cookie=13c343a2220dc8c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4cdfa700 1 -- 172.21.15.73:0/2957259213 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae501a73b0 con 0x7fae5010bb90 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4cdfa700 1 -- 172.21.15.73:0/2957259213 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800b840 con 0x7fae5010bb90 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae4cdfa700 1 -- 172.21.15.73:0/2957259213 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae4800ba20 con 0x7fae5010bb90 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 -- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 msgr2=0x7fae501a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.714 7fae548a2700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 0x7fae501a0270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fae500f47c0 tx=0x7fae48009cc0).stop 2024-03-24T10:39:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 -- 172.21.15.73:0/2957259213 shutdown_connections 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae5010bb90 0x7fae501a0270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 --2- 172.21.15.73:0/2957259213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500f5a10 0x7fae5010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 --2- 172.21.15.73:0/2957259213 >> v2:172.21.15.73:3300/0 conn(0x7fae5010b740 0x7fae5019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 -- 172.21.15.73:0/2957259213 >> 172.21.15.73:0/2957259213 conn(0x7fae50113a70 msgr2=0x7fae500f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 -- 172.21.15.73:0/2957259213 shutdown_connections 2024-03-24T10:39:45.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.715 7fae548a2700 1 -- 172.21.15.73:0/2957259213 wait complete. 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 Processor -- start 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 -- start start 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 0x7fae501ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 0x7fae501adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c46c0 con 0x7fae500f1ec0 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c6b30 con 0x7fae500c6ec0 2024-03-24T10:39:45.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.738 7fae548a2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c7310 con 0x7fae500f2310 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4ddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 0x7fae501adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 0x7fae501ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4ddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 0x7fae501adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48694/0 (socket says 172.21.15.73:48694) 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35702/0 (socket says 172.21.15.73:35702) 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4ddfc700 1 -- 172.21.15.73:0/303733328 learned_addr learned my addr 172.21.15.73:0/303733328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 -- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 msgr2=0x7fae501adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 0x7fae501adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 -- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 msgr2=0x7fae500f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 -- 172.21.15.73:0/303733328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae501ae250 con 0x7fae500f1ec0 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae4d5fb700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae44dfa700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 0x7fae501ad5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fae500c6ce0 tx=0x7fae3800ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae501ae250 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800be20 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae548a2700 1 -- 172.21.15.73:0/303733328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae501bb730 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fae3800f040 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.739 7fae548a2700 1 -- 172.21.15.73:0/303733328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae501bbb10 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.740 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fae38011070 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.740 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fae38010040 con 0x7fae500f1ec0 2024-03-24T10:39:45.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.740 7fae548a2700 1 -- 172.21.15.73:0/303733328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae500f08e0 con 0x7fae500f1ec0 2024-03-24T10:39:45.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.743 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fae3800c540 con 0x7fae500f1ec0 2024-03-24T10:39:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.848 7fae548a2700 1 -- 172.21.15.73:0/303733328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae501ae780 con 0x7fae500f1ec0 2024-03-24T10:39:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.848 7fae46ffd700 1 -- 172.21.15.73:0/303733328 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae38000c30 con 0x7fae500f1ec0 2024-03-24T10:39:45.850 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 -- 172.21.15.73:0/303733328 >> v1:172.21.15.73:6816/43277 conn(0x7fae340145b0 legacy=0x7fae34016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 -- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 msgr2=0x7fae501ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 0x7fae501ad5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fae500c6ce0 tx=0x7fae3800ed00).stop 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 -- 172.21.15.73:0/303733328 shutdown_connections 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fae500f2310 0x7fae501adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae500c6ec0 0x7fae500f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 --2- 172.21.15.73:0/303733328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae500f1ec0 0x7fae501ad5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.849 7fae548a2700 1 -- 172.21.15.73:0/303733328 >> 172.21.15.73:0/303733328 conn(0x7fae500c9e70 msgr2=0x7fae500ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.850 7fae548a2700 1 -- 172.21.15.73:0/303733328 shutdown_connections 2024-03-24T10:39:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.850 7fae548a2700 1 -- 172.21.15.73:0/303733328 wait complete. 2024-03-24T10:39:45.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.987 7f734df7e700 1 Processor -- start 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.987 7f734df7e700 1 -- start start 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f734df7e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f734df7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 0x7f734810e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f734df7e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480f91b0 con 0x7f73480f2290 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f734df7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734810f060 con 0x7f73480f1e40 2024-03-24T10:39:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f734df7e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73481ac600 con 0x7f73480f58a0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346571700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 0x7f734810e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48706/0 (socket says 172.21.15.73:48706) 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 -- 172.21.15.73:0/3481373613 learned_addr learned my addr 172.21.15.73:0/3481373613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7347573700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f73480f2290 0x7f734810e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39920/0 (socket says 172.21.15.73:39920) 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 -- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 msgr2=0x7f734810e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 0x7f734810e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 -- 172.21.15.73:0/3481373613 >> v1:172.21.15.73:6789/0 conn(0x7f73480f2290 legacy=0x7f734810e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7345d70700 1 -- 172.21.15.73:0/3481373613 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728855866 0 0) 0x7f7340001490 con 0x7f73480f2290 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 -- 172.21.15.73:0/3481373613 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73481ac7b0 con 0x7f73480f58a0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346571700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 0x7f734810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.988 7f7346d72700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7338002f70 tx=0x7f7338009a00).ready entity=mon.2 client_cookie=7df6b8ed29f4c69b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f7345d70700 1 -- 172.21.15.73:0/3481373613 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73481ac7b0 con 0x7f73480f58a0 2024-03-24T10:39:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f7345d70700 1 -- 172.21.15.73:0/3481373613 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800f510 con 0x7f73480f58a0 2024-03-24T10:39:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f7345d70700 1 -- 172.21.15.73:0/3481373613 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f733800f6f0 con 0x7f73480f58a0 2024-03-24T10:39:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 -- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 msgr2=0x7f73480f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7338002f70 tx=0x7f7338009a00).stop 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 -- 172.21.15.73:0/3481373613 shutdown_connections 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480f58a0 0x7f73480f1810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 --2- 172.21.15.73:0/3481373613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480f1e40 0x7f734810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 -- 172.21.15.73:0/3481373613 >> 172.21.15.73:0/3481373613 conn(0x7f73481139f0 msgr2=0x7f73480f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 -- 172.21.15.73:0/3481373613 shutdown_connections 2024-03-24T10:39:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:45.989 7f734df7e700 1 -- 172.21.15.73:0/3481373613 wait complete. 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 Processor -- start 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 -- start start 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 0x7f73481b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 0x7f73481b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c0d40 con 0x7f73480c4a10 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73481b5490 con 0x7f73480c3a50 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f734df7e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73481b56c0 con 0x7f73480c45c0 2024-03-24T10:39:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35720/0 (socket says 172.21.15.73:35720) 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7347573700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 0x7f73481b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 -- 172.21.15.73:0/2669138916 learned_addr learned my addr 172.21.15.73:0/2669138916 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346571700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 0x7f73481b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 -- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 msgr2=0x7f73481b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 0x7f73481b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 -- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 msgr2=0x7f73481b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.012 7f7346d72700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 0x7f73481b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f7346d72700 1 -- 172.21.15.73:0/2669138916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73481bbda0 con 0x7f73480c3a50 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f7346571700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 0x7f73481b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f7347573700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 0x7f73481b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f7346d72700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f73480c5290 tx=0x7f73380068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73481bbda0 con 0x7f73480c3a50 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73380117a0 con 0x7f73480c3a50 2024-03-24T10:39:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f734df7e700 1 -- 172.21.15.73:0/2669138916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73481bbfa0 con 0x7f73480c3a50 2024-03-24T10:39:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7338011b70 con 0x7f73480c3a50 2024-03-24T10:39:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.013 7f734df7e700 1 -- 172.21.15.73:0/2669138916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73481bc380 con 0x7f73480c3a50 2024-03-24T10:39:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.014 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7338019030 con 0x7f73480c3a50 2024-03-24T10:39:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.014 7f734df7e700 1 -- 172.21.15.73:0/2669138916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480f0860 con 0x7f73480c3a50 2024-03-24T10:39:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.014 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7338018040 con 0x7f73480c3a50 2024-03-24T10:39:46.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.017 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7338011590 con 0x7f73480c3a50 2024-03-24T10:39:46.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.122 7f734df7e700 1 -- 172.21.15.73:0/2669138916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73480e2fb0 con 0x7f73480c3a50 2024-03-24T10:39:46.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.122 7f733ffff700 1 -- 172.21.15.73:0/2669138916 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f733800f300 con 0x7f73480c3a50 2024-03-24T10:39:46.123 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.123 7f734df7e700 1 -- 172.21.15.73:0/2669138916 >> v1:172.21.15.73:6816/43277 conn(0x7f732c0145b0 legacy=0x7f732c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.123 7f734df7e700 1 -- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 msgr2=0x7f73480c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.123 7f734df7e700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f73480c5290 tx=0x7f73380068c0).stop 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 -- 172.21.15.73:0/2669138916 shutdown_connections 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73480c4a10 0x7f73481b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73480c3a50 0x7f73480c3f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 --2- 172.21.15.73:0/2669138916 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f73480c45c0 0x7f73481b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 -- 172.21.15.73:0/2669138916 >> 172.21.15.73:0/2669138916 conn(0x7f73480dc740 msgr2=0x7f73480c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 -- 172.21.15.73:0/2669138916 shutdown_connections 2024-03-24T10:39:46.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.124 7f734df7e700 1 -- 172.21.15.73:0/2669138916 wait complete. 2024-03-24T10:39:46.156 INFO:tasks.cephfs_test_runner:Starting test: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps) For nautilus it will crash the MDSs when receive unknown OPs, as a workaround 2024-03-24T10:39:46.157 INFO:tasks.cephfs_test_runner:test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps) 2024-03-24T10:39:46.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.282 7fc3e22e1700 1 Processor -- start 2024-03-24T10:39:46.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.282 7fc3e22e1700 1 -- start start 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 0x7fc3dc0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0fa290 con 0x7fc3dc0f5920 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0f95c0 con 0x7fc3dc10c970 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0f24f0 con 0x7fc3dc10cdc0 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db086700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48720/0 (socket says 172.21.15.73:48720) 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db086700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41432/0 (socket says 172.21.15.73:41432) 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3d2885700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 0x7fc3dc0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 -- 172.21.15.73:0/356816887 learned_addr learned my addr 172.21.15.73:0/356816887 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 -- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 msgr2=0x7fc3dc0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 0x7fc3dc0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 -- 172.21.15.73:0/356816887 >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 msgr2=0x7fc3dc10c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 --2- 172.21.15.73:0/356816887 >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 -- 172.21.15.73:0/356816887 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0f2720 con 0x7fc3dc10cdc0 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db086700 1 --2- 172.21.15.73:0/356816887 >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3d2885700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 0x7fc3dc0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3db887700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc3dc0f4640 tx=0x7fc3d4009dc0).ready entity=mon.2 client_cookie=148b12c11acfdb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3da885700 1 -- 172.21.15.73:0/356816887 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3dc0f2720 con 0x7fc3dc10cdc0 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3da885700 1 -- 172.21.15.73:0/356816887 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400b8d0 con 0x7fc3dc10cdc0 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3da885700 1 -- 172.21.15.73:0/356816887 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3d400bab0 con 0x7fc3dc10cdc0 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 -- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 msgr2=0x7fc3dc0f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.283 7fc3e22e1700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc3dc0f4640 tx=0x7fc3d4009dc0).stop 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 -- 172.21.15.73:0/356816887 shutdown_connections 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc10cdc0 0x7fc3dc0f1ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 --2- 172.21.15.73:0/356816887 >> v2:172.21.15.73:3300/0 conn(0x7fc3dc0f5920 0x7fc3dc10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 --2- 172.21.15.73:0/356816887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc10c970 0x7fc3dc0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 -- 172.21.15.73:0/356816887 >> 172.21.15.73:0/356816887 conn(0x7fc3dc113a70 msgr2=0x7fc3dc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 -- 172.21.15.73:0/356816887 shutdown_connections 2024-03-24T10:39:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.284 7fc3e22e1700 1 -- 172.21.15.73:0/356816887 wait complete. 2024-03-24T10:39:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 Processor -- start 2024-03-24T10:39:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 -- start start 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 0x7fc3dc1b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 0x7fc3dc1b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0c2910 con 0x7fc3dc0d3580 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1b0e50 con 0x7fc3dc0d3130 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3e22e1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1b1080 con 0x7fc3dc1a4730 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3db086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3d2885700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 0x7fc3dc1b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3db887700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 0x7fc3dc1b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3db086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48722/0 (socket says 172.21.15.73:48722) 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3db086700 1 -- 172.21.15.73:0/2385120854 learned_addr learned my addr 172.21.15.73:0/2385120854 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.307 7fc3d2885700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 0x7fc3dc1b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35726/0 (socket says 172.21.15.73:35726) 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 -- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 msgr2=0x7fc3dc1b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 0x7fc3dc1b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 -- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 msgr2=0x7fc3dc1b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 0x7fc3dc1b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 -- 172.21.15.73:0/2385120854 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0f0200 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db887700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 0x7fc3dc1b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3db086700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc3dc0c3300 tx=0x7fc3cc00df30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3dc0f0200 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc014040 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc1b78e0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3cc010af0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc1b7cc0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc3cc010cf0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.308 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc3cc019d10 con 0x7fc3dc1a4730 2024-03-24T10:39:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.309 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc0f08e0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.312 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc3cc00d0d0 con 0x7fc3dc1a4730 2024-03-24T10:39:46.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.418 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3dc0e2430 con 0x7fc3dc1a4730 2024-03-24T10:39:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.419 7fc3d9082700 1 -- 172.21.15.73:0/2385120854 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fc3cc000c30 con 0x7fc3dc1a4730 2024-03-24T10:39:46.420 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:46.420 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 >> v1:172.21.15.73:6816/43277 conn(0x7fc3c00145b0 legacy=0x7fc3c0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 msgr2=0x7fc3dc0d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc3dc0c3300 tx=0x7fc3cc00df30).stop 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 shutdown_connections 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3dc0d3580 0x7fc3dc1b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3dc1a4730 0x7fc3dc0d2b00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 --2- 172.21.15.73:0/2385120854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3dc0d3130 0x7fc3dc1b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 >> 172.21.15.73:0/2385120854 conn(0x7fc3dc0e08e0 msgr2=0x7fc3dc0c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 shutdown_connections 2024-03-24T10:39:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.420 7fc3e22e1700 1 -- 172.21.15.73:0/2385120854 wait complete. 2024-03-24T10:39:46.432 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:46.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:46.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.558 7f7a38192700 1 Processor -- start 2024-03-24T10:39:46.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 -- start start 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a301a0a70 con 0x7f7a3010b740 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300fa590 con 0x7f7a3010bb90 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a38192700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a0c90 con 0x7f7a300f5a10 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a34f8d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a3578e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a3578e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35734/0 (socket says 172.21.15.73:35734) 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a34f8d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48738/0 (socket says 172.21.15.73:48738) 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a2ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a3010b740 0x7f7a3019fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39926/0 (socket says 172.21.15.73:39926) 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.559 7f7a3578e700 1 -- 172.21.15.73:0/2389370991 learned_addr learned my addr 172.21.15.73:0/2389370991 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a2f7fe700 1 -- 172.21.15.73:0/2389370991 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783506622 0 0) 0x7f7a24001110 con 0x7f7a3010b740 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a34f8d700 1 -- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 msgr2=0x7f7a301a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a34f8d700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a34f8d700 1 -- 172.21.15.73:0/2389370991 >> v1:172.21.15.73:6789/0 conn(0x7f7a3010b740 legacy=0x7f7a3019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a34f8d700 1 -- 172.21.15.73:0/2389370991 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a301a93d0 con 0x7f7a300f5a10 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a3578e700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a34f8d700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7a300f47c0 tx=0x7f7a2000dd90).ready entity=mon.2 client_cookie=3db050330e04179 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a2f7fe700 1 -- 172.21.15.73:0/2389370991 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a301a93d0 con 0x7f7a300f5a10 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a2f7fe700 1 -- 172.21.15.73:0/2389370991 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2000f790 con 0x7f7a300f5a10 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a2f7fe700 1 -- 172.21.15.73:0/2389370991 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a20013070 con 0x7f7a300f5a10 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 -- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 msgr2=0x7f7a3010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7a300f47c0 tx=0x7f7a2000dd90).stop 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 -- 172.21.15.73:0/2389370991 shutdown_connections 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a3010bb90 0x7f7a301a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 --2- 172.21.15.73:0/2389370991 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300f5a10 0x7f7a3010b110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.560 7f7a38192700 1 -- 172.21.15.73:0/2389370991 >> 172.21.15.73:0/2389370991 conn(0x7f7a30113a70 msgr2=0x7f7a300f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.561 7f7a38192700 1 -- 172.21.15.73:0/2389370991 shutdown_connections 2024-03-24T10:39:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.561 7f7a38192700 1 -- 172.21.15.73:0/2389370991 wait complete. 2024-03-24T10:39:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.583 7f7a38192700 1 Processor -- start 2024-03-24T10:39:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.583 7f7a38192700 1 -- start start 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 0x7f7a301b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 0x7f7a301b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300d6ab0 con 0x7f7a300d6210 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300dd560 con 0x7f7a300d6660 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a38192700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300dd140 con 0x7f7a300d7390 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a34f8d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 0x7f7a301b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a34f8d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48746/0 (socket says 172.21.15.73:48746) 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a3578e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 0x7f7a301b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a34f8d700 1 -- 172.21.15.73:0/1503613664 learned_addr learned my addr 172.21.15.73:0/1503613664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 -- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 msgr2=0x7f7a300d5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 -- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 msgr2=0x7f7a301b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 0x7f7a301b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a2ffff700 1 -- 172.21.15.73:0/1503613664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a301b1600 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a34f8d700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.584 7f7a3578e700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 0x7f7a301b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2ffff700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 0x7f7a301b09a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7a24000bc0 tx=0x7f7a2400c800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a301b1600 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240070d0 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a38192700 1 -- 172.21.15.73:0/1503613664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a301b1920 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7a24005560 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a38192700 1 -- 172.21.15.73:0/1503613664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a301b8300 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7a24005970 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.585 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7a24014800 con 0x7f7a300d6210 2024-03-24T10:39:46.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.586 7f7a38192700 1 -- 172.21.15.73:0/1503613664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a300f08e0 con 0x7f7a300d6210 2024-03-24T10:39:46.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.589 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7a24005760 con 0x7f7a300d6210 2024-03-24T10:39:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.693 7f7a38192700 1 -- 172.21.15.73:0/1503613664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a301ab0c0 con 0x7f7a300d6210 2024-03-24T10:39:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.694 7f7a2dffb700 1 -- 172.21.15.73:0/1503613664 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a24000c30 con 0x7f7a300d6210 2024-03-24T10:39:46.696 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:46.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 >> v1:172.21.15.73:6816/43277 conn(0x7f7a100145b0 legacy=0x7f7a10016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 msgr2=0x7f7a301b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 0x7f7a301b09a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7a24000bc0 tx=0x7f7a2400c800).stop 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 shutdown_connections 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a300d6660 0x7f7a301b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7a300d7390 0x7f7a300d5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 --2- 172.21.15.73:0/1503613664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a300d6210 0x7f7a301b09a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 >> 172.21.15.73:0/1503613664 conn(0x7f7a300e0a90 msgr2=0x7f7a300cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 shutdown_connections 2024-03-24T10:39:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.695 7f7a38192700 1 -- 172.21.15.73:0/1503613664 wait complete. 2024-03-24T10:39:46.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.833 7febf286d700 1 Processor -- start 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 -- start start 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 0x7febec1a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febec1a6be0 0x7febec1a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec10cf90 con 0x7febec0f5920 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0fa290 con 0x7febec1a6be0 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febf286d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec0f95c0 con 0x7febec10cb40 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febebdec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febec1a6be0 0x7febec1a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febeb5eb700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7febec0f5920 0x7febec10c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39938/0 (socket says 172.21.15.73:39938) 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febeb5eb700 1 -- 172.21.15.73:0/614680341 learned_addr learned my addr 172.21.15.73:0/614680341 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:46.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.834 7febeadea700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 0x7febec1a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febebdec700 1 -- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 msgr2=0x7febec1a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febebdec700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 0x7febec1a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febebdec700 1 -- 172.21.15.73:0/614680341 >> v1:172.21.15.73:6789/0 conn(0x7febec0f5920 legacy=0x7febec10c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febebdec700 1 -- 172.21.15.73:0/614680341 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec1aa680 con 0x7febec1a6be0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febea5e9700 1 -- 172.21.15.73:0/614680341 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879943925 0 0) 0x7febdc001110 con 0x7febec0f5920 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febeadea700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 0x7febec1a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febebdec700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1a6be0 0x7febec1a9040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7febec0f9770 tx=0x7febe4009d40).ready entity=mon.0 client_cookie=d896f82f5ca77ae3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febea5e9700 1 -- 172.21.15.73:0/614680341 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febec1aa680 con 0x7febec1a6be0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febea5e9700 1 -- 172.21.15.73:0/614680341 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400b7c0 con 0x7febec1a6be0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febea5e9700 1 -- 172.21.15.73:0/614680341 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febe400b9f0 con 0x7febec1a6be0 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 -- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1a6be0 msgr2=0x7febec1a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1a6be0 0x7febec1a9040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7febec0f9770 tx=0x7febe4009d40).stop 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 -- 172.21.15.73:0/614680341 shutdown_connections 2024-03-24T10:39:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1a6be0 0x7febec1a9040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 --2- 172.21.15.73:0/614680341 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec10cb40 0x7febec1a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 -- 172.21.15.73:0/614680341 >> 172.21.15.73:0/614680341 conn(0x7febec113a70 msgr2=0x7febec0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 -- 172.21.15.73:0/614680341 shutdown_connections 2024-03-24T10:39:46.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.835 7febf286d700 1 -- 172.21.15.73:0/614680341 wait complete. 2024-03-24T10:39:46.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.858 7febf286d700 1 Processor -- start 2024-03-24T10:39:46.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.858 7febf286d700 1 -- start start 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.858 7febf286d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 0x7febec1ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 0x7febec1b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1a69a0 con 0x7febec1ae730 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec1a6c60 con 0x7febec1b4cd0 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec0f7840 con 0x7febec1adcb0 2024-03-24T10:39:46.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeb5eb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 0x7febec1ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febebdec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 0x7febec1b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41466/0 (socket says 172.21.15.73:41466) 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 -- 172.21.15.73:0/2808500583 learned_addr learned my addr 172.21.15.73:0/2808500583 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 -- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 msgr2=0x7febec1ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 0x7febec1ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 -- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 msgr2=0x7febec1b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 0x7febec1b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 -- 172.21.15.73:0/2808500583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec1bbe20 con 0x7febec1ae730 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febebdec700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 0x7febec1b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeb5eb700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 0x7febec1ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febeadea700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7febe000c000 tx=0x7febe000bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febec1bbe20 con 0x7febec1ae730 2024-03-24T10:39:46.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000c9a0 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febe000f040 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 -- 172.21.15.73:0/2808500583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec1bc020 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.859 7febf286d700 1 -- 172.21.15.73:0/2808500583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec1bc400 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.860 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7febe0011070 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.860 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7febe0010040 con 0x7febec1ae730 2024-03-24T10:39:46.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.860 7febf286d700 1 -- 172.21.15.73:0/2808500583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0f08e0 con 0x7febec1ae730 2024-03-24T10:39:46.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.863 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7febe000c5a0 con 0x7febec1ae730 2024-03-24T10:39:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.969 7febf286d700 1 -- 172.21.15.73:0/2808500583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febec1aedc0 con 0x7febec1ae730 2024-03-24T10:39:46.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.970 7febe8de6700 1 -- 172.21.15.73:0/2808500583 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7febe0000c30 con 0x7febec1ae730 2024-03-24T10:39:46.971 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 >> v1:172.21.15.73:6816/43277 conn(0x7febcc0145b0 legacy=0x7febcc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 msgr2=0x7febec1b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:46.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7febe000c000 tx=0x7febe000bf70).stop 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 shutdown_connections 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febec1b4cd0 0x7febec1b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7febec1adcb0 0x7febec1ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 --2- 172.21.15.73:0/2808500583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1ae730 0x7febec1b46a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 >> 172.21.15.73:0/2808500583 conn(0x7febec0c6c70 msgr2=0x7febec0d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 shutdown_connections 2024-03-24T10:39:46.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:46.971 7febf286d700 1 -- 172.21.15.73:0/2808500583 wait complete. 2024-03-24T10:39:46.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.109 7f8a4d07f700 1 Processor -- start 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.109 7f8a4d07f700 1 -- start start 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a4d07f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 0x7f8a4810b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a4d07f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 0x7f8a481a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a4d07f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a481a09f0 con 0x7f8a4810b6c0 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a4d07f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480fa510 con 0x7f8a480f5990 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a4d07f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481a0c10 con 0x7f8a4810bb10 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 0x7f8a481a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a455fb700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8a4810b6c0 0x7f8a4819fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39942/0 (socket says 172.21.15.73:39942) 2024-03-24T10:39:47.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a455fb700 1 -- 172.21.15.73:0/933812538 learned_addr learned my addr 172.21.15.73:0/933812538 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a45dfc700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 0x7f8a4810b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a44dfa700 1 -- 172.21.15.73:0/933812538 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859451397 0 0) 0x7f8a38001110 con 0x7f8a4810b6c0 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 -- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 msgr2=0x7f8a4810b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 0x7f8a4810b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 -- 172.21.15.73:0/933812538 >> v1:172.21.15.73:6789/0 conn(0x7f8a4810b6c0 legacy=0x7f8a4819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 -- 172.21.15.73:0/933812538 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a481a9350 con 0x7f8a4810bb10 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a45dfc700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 0x7f8a4810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a465fd700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 0x7f8a481a03c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8a480f4740 tx=0x7f8a40009cf0).ready entity=mon.2 client_cookie=5ef7d325c4b0e2ff server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.110 7f8a44dfa700 1 -- 172.21.15.73:0/933812538 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a481a9350 con 0x7f8a4810bb10 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a44dfa700 1 -- 172.21.15.73:0/933812538 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000b840 con 0x7f8a4810bb10 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a44dfa700 1 -- 172.21.15.73:0/933812538 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a4000ba20 con 0x7f8a4810bb10 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 -- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 msgr2=0x7f8a481a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 0x7f8a481a03c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8a480f4740 tx=0x7f8a40009cf0).stop 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 -- 172.21.15.73:0/933812538 shutdown_connections 2024-03-24T10:39:47.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a4810bb10 0x7f8a481a03c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 --2- 172.21.15.73:0/933812538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480f5990 0x7f8a4810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 -- 172.21.15.73:0/933812538 >> 172.21.15.73:0/933812538 conn(0x7f8a481139f0 msgr2=0x7f8a480f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:47.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 -- 172.21.15.73:0/933812538 shutdown_connections 2024-03-24T10:39:47.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.111 7f8a4d07f700 1 -- 172.21.15.73:0/933812538 wait complete. 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 Processor -- start 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 -- start start 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480d5e60 0x7f8a481a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a481a16a0 0x7f8a481b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480d9fd0 con 0x7f8a481a16a0 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480c48b0 con 0x7f8a480d5e60 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a4d07f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480d9bb0 con 0x7f8a480d53e0 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a45dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a45dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48770/0 (socket says 172.21.15.73:48770) 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a45dfc700 1 -- 172.21.15.73:0/287851004 learned_addr learned my addr 172.21.15.73:0/287851004 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a455fb700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480d5e60 0x7f8a481a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.134 7f8a465fd700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a481a16a0 0x7f8a481b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 -- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480d5e60 msgr2=0x7f8a481a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480d5e60 0x7f8a481a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 -- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a481a16a0 msgr2=0x7f8a481b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a481a16a0 0x7f8a481b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 -- 172.21.15.73:0/287851004 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480daad0 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a45dfc700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a480e6860 tx=0x7f8a3c00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a480daad0 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00ee60 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a481a1af0 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a3c00f040 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a481b8e50 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8a3c011070 con 0x7f8a480d53e0 2024-03-24T10:39:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.135 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8a3c010040 con 0x7f8a480d53e0 2024-03-24T10:39:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.136 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480f0860 con 0x7f8a480d53e0 2024-03-24T10:39:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.139 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8a3c00c620 con 0x7f8a480d53e0 2024-03-24T10:39:47.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.248 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a481ab870 con 0x7f8a480d53e0 2024-03-24T10:39:47.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.249 7f8a36ffd700 1 -- 172.21.15.73:0/287851004 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a3c000c30 con 0x7f8a480d53e0 2024-03-24T10:39:47.250 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 >> v1:172.21.15.73:6816/43277 conn(0x7f8a240145b0 legacy=0x7f8a24016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 msgr2=0x7f8a480d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a480e6860 tx=0x7f8a3c00bf70).stop 2024-03-24T10:39:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 shutdown_connections 2024-03-24T10:39:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a481a16a0 0x7f8a481b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8a480d53e0 0x7f8a480d5830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 --2- 172.21.15.73:0/287851004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a480d5e60 0x7f8a481a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 >> 172.21.15.73:0/287851004 conn(0x7f8a480c5850 msgr2=0x7f8a480c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:47.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 shutdown_connections 2024-03-24T10:39:47.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.250 7f8a4d07f700 1 -- 172.21.15.73:0/287851004 wait complete. 2024-03-24T10:39:47.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr' 2024-03-24T10:39:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 Processor -- start 2024-03-24T10:39:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 -- start start 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 0x7f3fe40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40f26c0 con 0x7f3fe410cdc0 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40fa290 con 0x7f3fe410c970 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3feac93700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40f95c0 con 0x7f3fe40f5920 2024-03-24T10:39:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3fe37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3fe37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35774/0 (socket says 172.21.15.73:35774) 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3fe37fe700 1 -- 172.21.15.73:0/1667965331 learned_addr learned my addr 172.21.15.73:0/1667965331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3fe3fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3fe410cdc0 0x7f3fe40f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39956/0 (socket says 172.21.15.73:39956) 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.387 7f3fe2ffd700 1 --2- 172.21.15.73:0/1667965331 >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 0x7f3fe40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe37fe700 1 -- 172.21.15.73:0/1667965331 >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 msgr2=0x7f3fe40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe37fe700 1 --2- 172.21.15.73:0/1667965331 >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 0x7f3fe40f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe37fe700 1 -- 172.21.15.73:0/1667965331 >> v1:172.21.15.73:6789/0 conn(0x7f3fe410cdc0 legacy=0x7f3fe40f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe37fe700 1 -- 172.21.15.73:0/1667965331 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe41aa5e0 con 0x7f3fe40f5920 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe2ffd700 1 --2- 172.21.15.73:0/1667965331 >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 0x7f3fe40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe37fe700 1 --2- 172.21.15.73:0/1667965331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3fd40032f0 tx=0x7f3fd4009d60).ready entity=mon.1 client_cookie=3eda3c7dd80aba31 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe27fc700 1 -- 172.21.15.73:0/1667965331 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fe41aa5e0 con 0x7f3fe40f5920 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe27fc700 1 -- 172.21.15.73:0/1667965331 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400b880 con 0x7f3fe40f5920 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3fe27fc700 1 -- 172.21.15.73:0/1667965331 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fd400ba60 con 0x7f3fe40f5920 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3feac93700 1 -- 172.21.15.73:0/1667965331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 msgr2=0x7f3fe410c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.388 7f3feac93700 1 --2- 172.21.15.73:0/1667965331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3fd40032f0 tx=0x7f3fd4009d60).stop 2024-03-24T10:39:47.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 -- 172.21.15.73:0/1667965331 shutdown_connections 2024-03-24T10:39:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 --2- 172.21.15.73:0/1667965331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe40f5920 0x7f3fe410c340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 --2- 172.21.15.73:0/1667965331 >> v2:172.21.15.73:3300/0 conn(0x7f3fe410c970 0x7f3fe40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 -- 172.21.15.73:0/1667965331 >> 172.21.15.73:0/1667965331 conn(0x7f3fe4113a70 msgr2=0x7f3fe40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 -- 172.21.15.73:0/1667965331 shutdown_connections 2024-03-24T10:39:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.389 7f3feac93700 1 -- 172.21.15.73:0/1667965331 wait complete. 2024-03-24T10:39:47.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.411 7f3feac93700 1 Processor -- start 2024-03-24T10:39:47.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.411 7f3feac93700 1 -- start start 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 0x7f3fe41abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 0x7f3fe41b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40d51d0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c4b00 con 0x7f3fe41b2a00 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3feac93700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41b3480 con 0x7f3fe41ab940 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 0x7f3fe41abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 0x7f3fe41b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41486/0 (socket says 172.21.15.73:41486) 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 0x7f3fe41abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48786/0 (socket says 172.21.15.73:48786) 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 -- 172.21.15.73:0/1732521755 learned_addr learned my addr 172.21.15.73:0/1732521755 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 -- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 msgr2=0x7f3fe41abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 0x7f3fe41abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 -- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 msgr2=0x7f3fe41b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 0x7f3fe41b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 -- 172.21.15.73:0/1732521755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40d47e0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe3fff700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 0x7f3fe41b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe2ffd700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3fe40c7570 tx=0x7f3fd800ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fe40d47e0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.412 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800c9a0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.413 7f3feac93700 1 -- 172.21.15.73:0/1732521755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40d5420 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.413 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3fd800f040 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.413 7f3feac93700 1 -- 172.21.15.73:0/1732521755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40f6570 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.413 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3fd8011070 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.413 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3fd8010040 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.414 7f3feac93700 1 -- 172.21.15.73:0/1732521755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe40f08e0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.418 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3fd800c5a0 con 0x7f3fe41ac3c0 2024-03-24T10:39:47.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:47.555 7f3feac93700 1 -- 172.21.15.73:0/1732521755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]} v 0) v1 -- 0x7f3fe40e2430 con 0x7f3fe41ac3c0 2024-03-24T10:39:48.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.183 7f3fe0ff9700 1 -- 172.21.15.73:0/1732521755 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]}]=0 v38) v1 ==== 139+0+0 (secure 0 0 0) 0x7f3fd8000c30 con 0x7f3fe41ac3c0 2024-03-24T10:39:48.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 >> v1:172.21.15.73:6816/43277 conn(0x7f3fc40145b0 legacy=0x7f3fc4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 msgr2=0x7f3fe41b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3fe40c7570 tx=0x7f3fd800ed00).stop 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 shutdown_connections 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fe41b2a00 0x7f3fe41b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f3fe41ab940 0x7f3fe41abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 --2- 172.21.15.73:0/1732521755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe41ac3c0 0x7f3fe41b23d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 >> 172.21.15.73:0/1732521755 conn(0x7f3fe40cfaa0 msgr2=0x7f3fe41a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 shutdown_connections 2024-03-24T10:39:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.185 7f3feac93700 1 -- 172.21.15.73:0/1732521755 wait complete. 2024-03-24T10:39:48.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 Processor -- start 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 -- start start 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 0x7f164410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16441a0a70 con 0x7f164410b740 2024-03-24T10:39:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16440fa590 con 0x7f164410bb90 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.333 7f164b992700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16441a0c90 con 0x7f16440f5a10 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1648f8e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 0x7f164410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1648f8e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41496/0 (socket says 172.21.15.73:41496) 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1648f8e700 1 -- 172.21.15.73:0/1117640371 learned_addr learned my addr 172.21.15.73:0/1117640371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 -- 172.21.15.73:0/1117640371 >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 msgr2=0x7f16441a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 --2- 172.21.15.73:0/1117640371 >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 -- 172.21.15.73:0/1117640371 >> v1:172.21.15.73:6789/0 conn(0x7f164410b740 legacy=0x7f164419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 -- 172.21.15.73:0/1117640371 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16441a93d0 con 0x7f16440f5a10 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1648f8e700 1 --2- 172.21.15.73:0/1117640371 >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1643fff700 1 --2- 172.21.15.73:0/1117640371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 0x7f164410b110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1638002f70 tx=0x7f163800b970).ready entity=mon.1 client_cookie=9f81358339be31ab server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1642ffd700 1 -- 172.21.15.73:0/1117640371 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16441a93d0 con 0x7f16440f5a10 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1642ffd700 1 -- 172.21.15.73:0/1117640371 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800d5c0 con 0x7f16440f5a10 2024-03-24T10:39:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f1642ffd700 1 -- 172.21.15.73:0/1117640371 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f163800d990 con 0x7f16440f5a10 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f164b992700 1 -- 172.21.15.73:0/1117640371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 msgr2=0x7f164410b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.334 7f164b992700 1 --2- 172.21.15.73:0/1117640371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 0x7f164410b110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1638002f70 tx=0x7f163800b970).stop 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 -- 172.21.15.73:0/1117640371 shutdown_connections 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 --2- 172.21.15.73:0/1117640371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440f5a10 0x7f164410b110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 --2- 172.21.15.73:0/1117640371 >> v2:172.21.15.73:3300/0 conn(0x7f164410bb90 0x7f16441a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 -- 172.21.15.73:0/1117640371 >> 172.21.15.73:0/1117640371 conn(0x7f1644113a70 msgr2=0x7f16440f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 -- 172.21.15.73:0/1117640371 shutdown_connections 2024-03-24T10:39:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.335 7f164b992700 1 -- 172.21.15.73:0/1117640371 wait complete. 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.357 7f164b992700 1 Processor -- start 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.357 7f164b992700 1 -- start start 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 0x7f16441b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16440c8c20 con 0x7f16441b1c80 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16441063d0 con 0x7f16440c7b90 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f164b992700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16440e1200 con 0x7f16440c8610 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1648f8e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35808/0 (socket says 172.21.15.73:35808) 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1648f8e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41498/0 (socket says 172.21.15.73:41498) 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 -- 172.21.15.73:0/2874179696 learned_addr learned my addr 172.21.15.73:0/2874179696 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f16437fe700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 0x7f16441b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 -- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 msgr2=0x7f16441b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 0x7f16441b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 -- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 msgr2=0x7f16441bbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1643fff700 1 -- 172.21.15.73:0/2874179696 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16440e0990 con 0x7f16440c7b90 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f1648f8e700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.358 7f16437fe700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 0x7f16441b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f1643fff700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f16440bbcc0 tx=0x7f16380068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16440e0990 con 0x7f16440c7b90 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638011980 con 0x7f16440c7b90 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1638017040 con 0x7f16440c7b90 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f164b992700 1 -- 172.21.15.73:0/2874179696 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16441b20d0 con 0x7f16440c7b90 2024-03-24T10:39:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.359 7f164b992700 1 -- 172.21.15.73:0/2874179696 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16441bc4c0 con 0x7f16440c7b90 2024-03-24T10:39:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.360 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1638026360 con 0x7f16440c7b90 2024-03-24T10:39:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.360 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1638018070 con 0x7f16440c7b90 2024-03-24T10:39:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.360 7f164b992700 1 -- 172.21.15.73:0/2874179696 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16440f08e0 con 0x7f16440c7b90 2024-03-24T10:39:48.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.363 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1638011770 con 0x7f16440c7b90 2024-03-24T10:39:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.468 7f164b992700 1 -- 172.21.15.73:0/2874179696 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f16440ce170 con 0x7f16440c7b90 2024-03-24T10:39:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.474 7f16417fa700 1 -- 172.21.15.73:0/2874179696 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f163800d3b0 con 0x7f16440c7b90 2024-03-24T10:39:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 >> v1:172.21.15.73:6816/43277 conn(0x7f16240145b0 legacy=0x7f1624016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 msgr2=0x7f16440c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f16440bbcc0 tx=0x7f16380068c0).stop 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 shutdown_connections 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16441b1c80 0x7f16441bbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16440c7b90 0x7f16440c7fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 --2- 172.21.15.73:0/2874179696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f16440c8610 0x7f16441b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 >> 172.21.15.73:0/2874179696 conn(0x7f16440db7a0 msgr2=0x7f16440c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 shutdown_connections 2024-03-24T10:39:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:48.475 7f164b992700 1 -- 172.21.15.73:0/2874179696 wait complete. 2024-03-24T10:39:48.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-24T10:39:48.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:39:48.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:39:48.668 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-24T10:39:48.669 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:39:48.669 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:39:48.714 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:39:48.714 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:39:48.798 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:39:48.799 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:39:48.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.009 7f221b5cf700 1 Processor -- start 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.009 7f221b5cf700 1 -- start start 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 0x7f22141a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 0x7f22141ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140f91b0 con 0x7f22140f58a0 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140f2460 con 0x7f22141a8c00 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140f2660 con 0x7f22140f2010 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2213fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f22140f58a0 0x7f22140f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39964/0 (socket says 172.21.15.73:39964) 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2213fff700 1 -- 172.21.15.73:0/2289387057 learned_addr learned my addr 172.21.15.73:0/2289387057 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 --2- 172.21.15.73:0/2289387057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 0x7f22141a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2218bcb700 1 --2- 172.21.15.73:0/2289387057 >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 0x7f22141ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2212ffd700 1 -- 172.21.15.73:0/2289387057 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696326821 0 0) 0x7f2208001110 con 0x7f22140f58a0 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2212ffd700 1 -- 172.21.15.73:0/2289387057 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2200003270 con 0x7f22140f58a0 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 -- 172.21.15.73:0/2289387057 >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 msgr2=0x7f22141ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 --2- 172.21.15.73:0/2289387057 >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 0x7f22141ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 -- 172.21.15.73:0/2289387057 >> v1:172.21.15.73:6789/0 conn(0x7f22140f58a0 legacy=0x7f22140f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 -- 172.21.15.73:0/2289387057 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22141ac6a0 con 0x7f22140f2010 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2218bcb700 1 --2- 172.21.15.73:0/2289387057 >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 0x7f22141ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f22137fe700 1 --2- 172.21.15.73:0/2289387057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 0x7f22141a85d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2204002f70 tx=0x7f220400b970).ready entity=mon.1 client_cookie=1a7cfd131da27ef6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2212ffd700 1 -- 172.21.15.73:0/2289387057 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22141ac6a0 con 0x7f22140f2010 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2212ffd700 1 -- 172.21.15.73:0/2289387057 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400d5c0 con 0x7f22140f2010 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f2212ffd700 1 -- 172.21.15.73:0/2289387057 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f220400d9e0 con 0x7f22140f2010 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 -- 172.21.15.73:0/2289387057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 msgr2=0x7f22141a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.010 7f221b5cf700 1 --2- 172.21.15.73:0/2289387057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 0x7f22141a85d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2204002f70 tx=0x7f220400b970).stop 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 -- 172.21.15.73:0/2289387057 shutdown_connections 2024-03-24T10:39:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 --2- 172.21.15.73:0/2289387057 >> v2:172.21.15.73:3300/0 conn(0x7f22141a8c00 0x7f22141ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 --2- 172.21.15.73:0/2289387057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22140f2010 0x7f22141a85d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 -- 172.21.15.73:0/2289387057 >> 172.21.15.73:0/2289387057 conn(0x7f22141139f0 msgr2=0x7f22140f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 -- 172.21.15.73:0/2289387057 shutdown_connections 2024-03-24T10:39:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.011 7f221b5cf700 1 -- 172.21.15.73:0/2289387057 wait complete. 2024-03-24T10:39:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 Processor -- start 2024-03-24T10:39:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 -- start start 2024-03-24T10:39:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f22140c6db0 0x7f22141a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22141a78e0 0x7f22141b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140e4430 con 0x7f22141a7490 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140d7430 con 0x7f22141a78e0 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f221b5cf700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22141b4f30 con 0x7f22140c6db0 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f22137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f2218bcb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22141a78e0 0x7f22141b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f22137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41516/0 (socket says 172.21.15.73:41516) 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f22137fe700 1 -- 172.21.15.73:0/547929152 learned_addr learned my addr 172.21.15.73:0/547929152 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.034 7f2213fff700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f22140c6db0 0x7f22141a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 -- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f22140c6db0 msgr2=0x7f22141a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f22140c6db0 0x7f22141a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 -- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22141a78e0 msgr2=0x7f22141b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22141a78e0 0x7f22141b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 -- 172.21.15.73:0/547929152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22141b5160 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22137fe700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2204002f70 tx=0x7f22040068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22141b5160 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040119a0 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2204017040 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f221b5cf700 1 -- 172.21.15.73:0/547929152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22141bb9c0 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f221b5cf700 1 -- 172.21.15.73:0/547929152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22141bbda0 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2204006a90 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.035 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2204018070 con 0x7f22141a7490 2024-03-24T10:39:49.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.036 7f221b5cf700 1 -- 172.21.15.73:0/547929152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22140f0860 con 0x7f22141a7490 2024-03-24T10:39:49.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.039 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2204011790 con 0x7f22141a7490 2024-03-24T10:39:49.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.144 7f221b5cf700 1 -- 172.21.15.73:0/547929152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22140f2240 con 0x7f22141a7490 2024-03-24T10:39:49.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.145 7f22117fa700 1 -- 172.21.15.73:0/547929152 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f220400d3b0 con 0x7f22141a7490 2024-03-24T10:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 >> v1:172.21.15.73:6816/43277 conn(0x7f21f40145b0 legacy=0x7f21f4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 msgr2=0x7f22141b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2204002f70 tx=0x7f22040068c0).stop 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 shutdown_connections 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22141a78e0 0x7f22141b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f22140c6db0 0x7f22141a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 --2- 172.21.15.73:0/547929152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22141a7490 0x7f22141b42d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 >> 172.21.15.73:0/547929152 conn(0x7f22140cc380 msgr2=0x7f22140da430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 shutdown_connections 2024-03-24T10:39:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.146 7f221b5cf700 1 -- 172.21.15.73:0/547929152 wait complete. 2024-03-24T10:39:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:49.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.286 7fc89826f700 1 Processor -- start 2024-03-24T10:39:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 -- start start 2024-03-24T10:39:49.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 0x7fc89019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8901a0a70 con 0x7fc89010bb90 2024-03-24T10:39:49.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900fa590 con 0x7fc89010b740 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89826f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901a0c90 con 0x7fc8900f5a10 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89506a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc894869700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 0x7fc89019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89506a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48818/0 (socket says 172.21.15.73:48818) 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89506a700 1 -- 172.21.15.73:0/740677417 learned_addr learned my addr 172.21.15.73:0/740677417 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.287 7fc89586b700 1 --1- 172.21.15.73:0/740677417 >> v1:172.21.15.73:6789/0 conn(0x7fc89010bb90 0x7fc8901a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39966/0 (socket says 172.21.15.73:39966) 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc88ffff700 1 -- 172.21.15.73:0/740677417 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258562757 0 0) 0x7fc880001110 con 0x7fc89010bb90 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89506a700 1 -- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 msgr2=0x7fc89019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89506a700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 0x7fc89019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89506a700 1 -- 172.21.15.73:0/740677417 >> v1:172.21.15.73:6789/0 conn(0x7fc89010bb90 legacy=0x7fc8901a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89506a700 1 -- 172.21.15.73:0/740677417 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8901a93d0 con 0x7fc8900f5a10 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc894869700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 0x7fc89019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89506a700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc89010f920 tx=0x7fc888009a30).ready entity=mon.2 client_cookie=c28f9d0fbae778a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc88ffff700 1 -- 172.21.15.73:0/740677417 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8901a93d0 con 0x7fc8900f5a10 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc88ffff700 1 -- 172.21.15.73:0/740677417 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800f510 con 0x7fc8900f5a10 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc88ffff700 1 -- 172.21.15.73:0/740677417 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc88800f6f0 con 0x7fc8900f5a10 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 -- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 msgr2=0x7fc89010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc89010f920 tx=0x7fc888009a30).stop 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 -- 172.21.15.73:0/740677417 shutdown_connections 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900f5a10 0x7fc89010b110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 --2- 172.21.15.73:0/740677417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89010b740 0x7fc89019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.288 7fc89826f700 1 -- 172.21.15.73:0/740677417 >> 172.21.15.73:0/740677417 conn(0x7fc890113a70 msgr2=0x7fc8900f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.289 7fc89826f700 1 -- 172.21.15.73:0/740677417 shutdown_connections 2024-03-24T10:39:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.289 7fc89826f700 1 -- 172.21.15.73:0/740677417 wait complete. 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.311 7fc89826f700 1 Processor -- start 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.311 7fc89826f700 1 -- start start 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 0x7fc8901b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 0x7fc8900c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 0x7fc8901b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901b3790 con 0x7fc8901b3340 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900d74a0 con 0x7fc8900c19a0 2024-03-24T10:39:49.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900c1df0 con 0x7fc8900c0d80 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89506a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 0x7fc8901b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 0x7fc8901b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc894869700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 0x7fc8900c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89506a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 0x7fc8901b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48830/0 (socket says 172.21.15.73:48830) 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89506a700 1 -- 172.21.15.73:0/3727825514 learned_addr learned my addr 172.21.15.73:0/3727825514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 -- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 msgr2=0x7fc8901b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 0x7fc8901b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 -- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 msgr2=0x7fc8900c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 0x7fc8900c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 -- 172.21.15.73:0/3727825514 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900c2020 con 0x7fc8900c19a0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc894869700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 0x7fc8900c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89586b700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 0x7fc8901b9bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc8900e0c70 tx=0x7fc88000c830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8900c2020 con 0x7fc8900c19a0 2024-03-24T10:39:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800070d0 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc89826f700 1 -- 172.21.15.73:0/3727825514 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8901ba1f0 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.312 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc880005560 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.313 7fc89826f700 1 -- 172.21.15.73:0/3727825514 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8901ba5d0 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.313 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc880005760 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.313 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc88000f6c0 con 0x7fc8900c19a0 2024-03-24T10:39:49.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.313 7fc89826f700 1 -- 172.21.15.73:0/3727825514 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8900f08e0 con 0x7fc8900c19a0 2024-03-24T10:39:49.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.317 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc88001d360 con 0x7fc8900c19a0 2024-03-24T10:39:49.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.422 7fc89826f700 1 -- 172.21.15.73:0/3727825514 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8900e2430 con 0x7fc8900c19a0 2024-03-24T10:39:49.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.422 7fc88e7fc700 1 -- 172.21.15.73:0/3727825514 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8901145f0 con 0x7fc8900c19a0 2024-03-24T10:39:49.422 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 -- 172.21.15.73:0/3727825514 >> v1:172.21.15.73:6816/43277 conn(0x7fc8700145b0 legacy=0x7fc870016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 -- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 msgr2=0x7fc8901b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 0x7fc8901b9bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc8900e0c70 tx=0x7fc88000c830).stop 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 -- 172.21.15.73:0/3727825514 shutdown_connections 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc8900c19a0 0x7fc8901b9bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc8900c0d80 0x7fc8901b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 --2- 172.21.15.73:0/3727825514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8901b3340 0x7fc8900c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.423 7fc89826f700 1 -- 172.21.15.73:0/3727825514 >> 172.21.15.73:0/3727825514 conn(0x7fc8900bc830 msgr2=0x7fc8900d7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.424 7fc89826f700 1 -- 172.21.15.73:0/3727825514 shutdown_connections 2024-03-24T10:39:49.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.424 7fc89826f700 1 -- 172.21.15.73:0/3727825514 wait complete. 2024-03-24T10:39:49.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 Processor -- start 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 -- start start 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3088104e20 con 0x7f30881a1400 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308810d1c0 con 0x7f308810cd70 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f308e777700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30880f2290 con 0x7f30880fb120 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30873b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f3086baf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30873b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:48838/0 (socket says 172.21.15.73:48838) 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f3086baf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35838/0 (socket says 172.21.15.73:35838) 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30873b0700 1 -- 172.21.15.73:0/173780831 learned_addr learned my addr 172.21.15.73:0/173780831 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f3087bb1700 1 --1- 172.21.15.73:0/173780831 >> v1:172.21.15.73:6789/0 conn(0x7f30881a1400 0x7f30881a1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39976/0 (socket says 172.21.15.73:39976) 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30873b0700 1 -- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 msgr2=0x7f30881a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30873b0700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30873b0700 1 -- 172.21.15.73:0/173780831 >> v1:172.21.15.73:6789/0 conn(0x7f30881a1400 legacy=0x7f30881a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.563 7f30863ae700 1 -- 172.21.15.73:0/173780831 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231173172 0 0) 0x7f3080001490 con 0x7f30881a1400 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30873b0700 1 -- 172.21.15.73:0/173780831 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30881aa2b0 con 0x7f30880fb120 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f3086baf700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30873b0700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f307c002f70 tx=0x7f307c009a00).ready entity=mon.2 client_cookie=4c4bd3435b07f0df server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30863ae700 1 -- 172.21.15.73:0/173780831 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30881aa2b0 con 0x7f30880fb120 2024-03-24T10:39:49.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30863ae700 1 -- 172.21.15.73:0/173780831 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c00f510 con 0x7f30880fb120 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f30863ae700 1 -- 172.21.15.73:0/173780831 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f307c00f6f0 con 0x7f30880fb120 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 -- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 msgr2=0x7f308810c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f307c002f70 tx=0x7f307c009a00).stop 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 -- 172.21.15.73:0/173780831 shutdown_connections 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30880fb120 0x7f308810c740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 --2- 172.21.15.73:0/173780831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f308810cd70 0x7f30881a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 -- 172.21.15.73:0/173780831 >> 172.21.15.73:0/173780831 conn(0x7f3088114940 msgr2=0x7f3088114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 -- 172.21.15.73:0/173780831 shutdown_connections 2024-03-24T10:39:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.564 7f308e777700 1 -- 172.21.15.73:0/173780831 wait complete. 2024-03-24T10:39:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 Processor -- start 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 -- start start 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 0x7f30880d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 0x7f30881b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880a2570 con 0x7f30880d3ef0 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30880c7940 con 0x7f30881a4df0 2024-03-24T10:39:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.587 7f308e777700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30880c80c0 con 0x7f30881a5870 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3086baf700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 0x7f30880d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35840/0 (socket says 172.21.15.73:35840) 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 -- 172.21.15.73:0/45202409 learned_addr learned my addr 172.21.15.73:0/45202409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3087bb1700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 0x7f30881b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 -- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 msgr2=0x7f30880d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 0x7f30880d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 -- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 msgr2=0x7f30881b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 0x7f30881b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 -- 172.21.15.73:0/45202409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880c7230 con 0x7f30881a4df0 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3087bb1700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 0x7f30881b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3086baf700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 0x7f30880d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f30873b0700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f30880c8a20 tx=0x7f307c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30880c7230 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c011920 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f308e777700 1 -- 172.21.15.73:0/45202409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880c75b0 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f307c011cf0 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.588 7f308e777700 1 -- 172.21.15.73:0/45202409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880d4520 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.589 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f307c027460 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.589 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f307c020ba0 con 0x7f30881a4df0 2024-03-24T10:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.589 7f308e777700 1 -- 172.21.15.73:0/45202409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30880f08e0 con 0x7f30881a4df0 2024-03-24T10:39:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.592 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f307c011710 con 0x7f30881a4df0 2024-03-24T10:39:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.697 7f308e777700 1 -- 172.21.15.73:0/45202409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30881ac960 con 0x7f30881a4df0 2024-03-24T10:39:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.698 7f3084bab700 1 -- 172.21.15.73:0/45202409 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f307c00f300 con 0x7f30881a4df0 2024-03-24T10:39:49.698 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 >> v1:172.21.15.73:6816/43277 conn(0x7f30680145b0 legacy=0x7f3068016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 msgr2=0x7f30881a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f30880c8a20 tx=0x7f307c0068c0).stop 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 shutdown_connections 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30880d3ef0 0x7f30881b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30881a4df0 0x7f30881a5240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 --2- 172.21.15.73:0/45202409 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f30881a5870 0x7f30880d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 >> 172.21.15.73:0/45202409 conn(0x7f30880cc5a0 msgr2=0x7f30880da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 shutdown_connections 2024-03-24T10:39:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.699 7f308e777700 1 -- 172.21.15.73:0/45202409 wait complete. 2024-03-24T10:39:49.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 Processor -- start 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 -- start start 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effe810bb10 0x7effe81a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe81a09f0 con 0x7effe810b6c0 2024-03-24T10:39:49.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe80fa510 con 0x7effe810bb10 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effecc78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe81a0c10 con 0x7effe80f5990 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effe5a63700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effe6264700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effe810bb10 0x7effe81a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effdffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7effe810b6c0 0x7effe819fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39978/0 (socket says 172.21.15.73:39978) 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effe6264700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effe810bb10 0x7effe81a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41552/0 (socket says 172.21.15.73:41552) 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effe5a63700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35842/0 (socket says 172.21.15.73:35842) 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.838 7effdffff700 1 -- 172.21.15.73:0/1337104780 learned_addr learned my addr 172.21.15.73:0/1337104780 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe6264700 1 -- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 msgr2=0x7effe810b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe6264700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe6264700 1 -- 172.21.15.73:0/1337104780 >> v1:172.21.15.73:6789/0 conn(0x7effe810b6c0 legacy=0x7effe819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe6264700 1 -- 172.21.15.73:0/1337104780 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe81a9350 con 0x7effe810bb10 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe5262700 1 -- 172.21.15.73:0/1337104780 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298058630 0 0) 0x7effd0001110 con 0x7effe810b6c0 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe5a63700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe6264700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe810bb10 0x7effe81a03c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7effe00032f0 tx=0x7effe0009d10).ready entity=mon.0 client_cookie=7d5db9a0b316d461 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe5262700 1 -- 172.21.15.73:0/1337104780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effe81a9350 con 0x7effe810bb10 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe5262700 1 -- 172.21.15.73:0/1337104780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe000b800 con 0x7effe810bb10 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effe5262700 1 -- 172.21.15.73:0/1337104780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effe000b9e0 con 0x7effe810bb10 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effecc78700 1 -- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe810bb10 msgr2=0x7effe81a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.839 7effecc78700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe810bb10 0x7effe81a03c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7effe00032f0 tx=0x7effe0009d10).stop 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 -- 172.21.15.73:0/1337104780 shutdown_connections 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80f5990 0x7effe810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 --2- 172.21.15.73:0/1337104780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe810bb10 0x7effe81a03c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 -- 172.21.15.73:0/1337104780 >> 172.21.15.73:0/1337104780 conn(0x7effe81139f0 msgr2=0x7effe80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 -- 172.21.15.73:0/1337104780 shutdown_connections 2024-03-24T10:39:49.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.840 7effecc78700 1 -- 172.21.15.73:0/1337104780 wait complete. 2024-03-24T10:39:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.862 7effecc78700 1 Processor -- start 2024-03-24T10:39:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.862 7effecc78700 1 -- start start 2024-03-24T10:39:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 0x7effe81b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7effe81b14b0 0x7effe81b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe80cd870 con 0x7effe80d61e0 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80cd540 con 0x7effe80d6c60 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effecc78700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe81a5a40 con 0x7effe81b14b0 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effe5a63700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 0x7effe81b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effe6264700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7effe81b14b0 0x7effe81b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effe5a63700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41556/0 (socket says 172.21.15.73:41556) 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effe5a63700 1 -- 172.21.15.73:0/3268350952 learned_addr learned my addr 172.21.15.73:0/3268350952 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 -- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7effe81b14b0 msgr2=0x7effe81b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7effe81b14b0 0x7effe81b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 -- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 msgr2=0x7effe80d6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 -- 172.21.15.73:0/3268350952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80ce190 con 0x7effe80d6c60 2024-03-24T10:39:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effe5a63700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdffff700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 0x7effe81b0e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7effe80c2450 tx=0x7effd000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.863 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effe80ce190 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000ce10 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effecc78700 1 -- 172.21.15.73:0/3268350952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe80f1810 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effd0005620 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effecc78700 1 -- 172.21.15.73:0/3268350952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe80f1dc0 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7effd0005820 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.864 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7effd0014a90 con 0x7effe80d6c60 2024-03-24T10:39:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.865 7effecc78700 1 -- 172.21.15.73:0/3268350952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe80f0860 con 0x7effe80d6c60 2024-03-24T10:39:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.868 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7effd00070d0 con 0x7effe80d6c60 2024-03-24T10:39:49.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.972 7effecc78700 1 -- 172.21.15.73:0/3268350952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effe81ab5a0 con 0x7effe80d6c60 2024-03-24T10:39:49.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.973 7effdeffd700 1 -- 172.21.15.73:0/3268350952 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7effd0000c30 con 0x7effe80d6c60 2024-03-24T10:39:49.973 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 >> v1:172.21.15.73:6816/43277 conn(0x7effcc0145b0 legacy=0x7effcc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 msgr2=0x7effe81b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 0x7effe81b0e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7effe80c2450 tx=0x7effd000c860).stop 2024-03-24T10:39:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 shutdown_connections 2024-03-24T10:39:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7effe81b14b0 0x7effe81b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effe80d61e0 0x7effe80d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 --2- 172.21.15.73:0/3268350952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effe80d6c60 0x7effe81b0e80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 >> 172.21.15.73:0/3268350952 conn(0x7effe80c3a10 msgr2=0x7effe80dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 shutdown_connections 2024-03-24T10:39:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:49.974 7effecc78700 1 -- 172.21.15.73:0/3268350952 wait complete. 2024-03-24T10:39:49.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:39:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 Processor -- start 2024-03-24T10:39:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 -- start start 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7b810b6b0 0x7fe7b819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b81a09e0 con 0x7fe7b810bb00 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80fa500 con 0x7fe7b810b6b0 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.113 7fe7bd7d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b81a0c00 con 0x7fe7b80f5980 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7b810b6b0 0x7fe7b819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b65c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7b810b6b0 0x7fe7b819fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41560/0 (socket says 172.21.15.73:41560) 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b6dc6700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe7b810bb00 0x7fe7b81a01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39994/0 (socket says 172.21.15.73:39994) 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 -- 172.21.15.73:0/3221192478 learned_addr learned my addr 172.21.15.73:0/3221192478 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b65c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:35870/0 (socket says 172.21.15.73:35870) 2024-03-24T10:39:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 -- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 msgr2=0x7fe7b810b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 -- 172.21.15.73:0/3221192478 >> v1:172.21.15.73:6789/0 conn(0x7fe7b810bb00 legacy=0x7fe7b81a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 -- 172.21.15.73:0/3221192478 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b81a9340 con 0x7fe7b810b6b0 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b55c3700 1 -- 172.21.15.73:0/3221192478 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689479518 0 0) 0x7fe7b0001490 con 0x7fe7b810bb00 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b65c5700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b5dc4700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b810b6b0 0x7fe7b819fbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe7ac002f70 tx=0x7fe7ac009a50).ready entity=mon.0 client_cookie=611a448c02ad2051 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b55c3700 1 -- 172.21.15.73:0/3221192478 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7b81a9340 con 0x7fe7b810b6b0 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b55c3700 1 -- 172.21.15.73:0/3221192478 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00f510 con 0x7fe7b810b6b0 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7b55c3700 1 -- 172.21.15.73:0/3221192478 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7ac00f6f0 con 0x7fe7b810b6b0 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7bd7d5700 1 -- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b810b6b0 msgr2=0x7fe7b819fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.114 7fe7bd7d5700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b810b6b0 0x7fe7b819fbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe7ac002f70 tx=0x7fe7ac009a50).stop 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 -- 172.21.15.73:0/3221192478 shutdown_connections 2024-03-24T10:39:50.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b80f5980 0x7fe7b810b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 --2- 172.21.15.73:0/3221192478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b810b6b0 0x7fe7b819fbb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 -- 172.21.15.73:0/3221192478 >> 172.21.15.73:0/3221192478 conn(0x7fe7b81139e0 msgr2=0x7fe7b80f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 -- 172.21.15.73:0/3221192478 shutdown_connections 2024-03-24T10:39:50.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.115 7fe7bd7d5700 1 -- 172.21.15.73:0/3221192478 wait complete. 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 Processor -- start 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 -- start start 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7b80be8f0 0x7fe7b81b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 0x7fe7b81bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8088d60 con 0x7fe7b80bde70 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80bb420 con 0x7fe7b81b4c20 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7bd7d5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80bf250 con 0x7fe7b80be8f0 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7b65c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7b65c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41576/0 (socket says 172.21.15.73:41576) 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7b65c5700 1 -- 172.21.15.73:0/1937395807 learned_addr learned my addr 172.21.15.73:0/1937395807 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7b6dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 0x7fe7b81bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.138 7fe7b5dc4700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7b80be8f0 0x7fe7b81b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 -- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7b80be8f0 msgr2=0x7fe7b81b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7b80be8f0 0x7fe7b81b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 -- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 msgr2=0x7fe7b81bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 0x7fe7b81bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 -- 172.21.15.73:0/1937395807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b81b5070 con 0x7fe7b80bde70 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b6dc6700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 0x7fe7b81bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7b65c5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe7b80bc000 tx=0x7fe7a800bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7b81b5070 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800c9a0 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b81b5390 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7a800f040 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.139 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81bc480 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.140 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe7a8011070 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.140 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe7a8010040 con 0x7fe7b80bde70 2024-03-24T10:39:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.140 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b80f0850 con 0x7fe7b80bde70 2024-03-24T10:39:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.144 7fe7a77fe700 1 -- 172.21.15.73:0/1937395807 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe7a800c5a0 con 0x7fe7b80bde70 2024-03-24T10:39:50.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 >> v1:172.21.15.73:6816/43277 conn(0x7fe7940145b0 legacy=0x7fe794016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 msgr2=0x7fe7b80be2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe7b80bc000 tx=0x7fe7a800bf70).stop 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 shutdown_connections 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7b81b4c20 0x7fe7b81bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7b80bde70 0x7fe7b80be2c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 --2- 172.21.15.73:0/1937395807 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe7b80be8f0 0x7fe7b81b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 >> 172.21.15.73:0/1937395807 conn(0x7fe7b80c5c10 msgr2=0x7fe7b80c0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 shutdown_connections 2024-03-24T10:39:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.288 7fe7bd7d5700 1 -- 172.21.15.73:0/1937395807 wait complete. 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd perf 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd df {plain|tree} {class|name} {} 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd blocked-by 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool stats {} 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool scrub [...] 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool deep-scrub [...] 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool repair [...] 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-recovery [...] 2024-03-24T10:39:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-backfill [...] 2024-03-24T10:39:50.291 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool cancel-force-recovery [...] 2024-03-24T10:39:50.291 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:39:50.298 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:39:50.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.425 7f9567126700 1 Processor -- start 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.425 7f9567126700 1 -- start start 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f9567126700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95600f5910 0x7f95600f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f9567126700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 0x7f956010e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f9567126700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95600f9220 con 0x7f95600f2300 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f9567126700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956010f0d0 con 0x7f95600f5910 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95600f5910 0x7f95600f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95600f2300 0x7f956010e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40890/0 (socket says 172.21.15.73:40890) 2024-03-24T10:39:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955ffff700 1 -- 172.21.15.73:0/938641498 learned_addr learned my addr 172.21.15.73:0/938641498 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955effd700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 0x7f956010e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f9567126700 1 -- 172.21.15.73:0/938641498 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95601ac670 con 0x7f95600f1eb0 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955e7fc700 1 -- 172.21.15.73:0/938641498 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664634617 0 0) 0x7f9558001110 con 0x7f95600f2300 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955e7fc700 1 -- 172.21.15.73:0/938641498 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c003270 con 0x7f95600f2300 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 -- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 msgr2=0x7f956010e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 0x7f956010e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 -- 172.21.15.73:0/938641498 >> v1:172.21.15.73:6789/0 conn(0x7f95600f2300 legacy=0x7f956010e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 -- 172.21.15.73:0/938641498 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95601ac820 con 0x7f95600f5910 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955effd700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 0x7f956010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.426 7f955f7fe700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600f5910 0x7f95600f1880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f95500032f0 tx=0x7f9550009d10).ready entity=mon.0 client_cookie=b90036c1161761be server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f955e7fc700 1 -- 172.21.15.73:0/938641498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95601ac820 con 0x7f95600f5910 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f955e7fc700 1 -- 172.21.15.73:0/938641498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955000b800 con 0x7f95600f5910 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f955e7fc700 1 -- 172.21.15.73:0/938641498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f955000ba30 con 0x7f95600f5910 2024-03-24T10:39:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 -- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600f5910 msgr2=0x7f95600f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600f5910 0x7f95600f1880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f95500032f0 tx=0x7f9550009d10).stop 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 -- 172.21.15.73:0/938641498 shutdown_connections 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600f5910 0x7f95600f1880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 --2- 172.21.15.73:0/938641498 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600f1eb0 0x7f956010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 -- 172.21.15.73:0/938641498 >> 172.21.15.73:0/938641498 conn(0x7f9560113a60 msgr2=0x7f95600f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 -- 172.21.15.73:0/938641498 shutdown_connections 2024-03-24T10:39:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.427 7f9567126700 1 -- 172.21.15.73:0/938641498 wait complete. 2024-03-24T10:39:50.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 Processor -- start 2024-03-24T10:39:50.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 -- start start 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 0x7f95601b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600e6600 con 0x7f95600c4e70 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600bc220 con 0x7f95600cea20 2024-03-24T10:39:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f9567126700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95601b4c50 con 0x7f95600cee70 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43882/0 (socket says 172.21.15.73:43882) 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:54910/0 (socket says 172.21.15.73:54910) 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955f7fe700 1 -- 172.21.15.73:0/2599013759 learned_addr learned my addr 172.21.15.73:0/2599013759 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.450 7f955ffff700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 0x7f95601b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 -- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 msgr2=0x7f95601b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 -- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 msgr2=0x7f95600ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 -- 172.21.15.73:0/2599013759 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95601b4e80 con 0x7f95600cee70 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955f7fe700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955effd700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955ffff700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 0x7f95601b4620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f95600e1590 tx=0x7f955800c790).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95601b4e80 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558007110 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f9567126700 1 -- 172.21.15.73:0/2599013759 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95601bb770 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9558005030 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.451 7f9567126700 1 -- 172.21.15.73:0/2599013759 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95601bbb50 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.452 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9558005600 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.452 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f955800ba80 con 0x7f95600cee70 2024-03-24T10:39:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.452 7f9567126700 1 -- 172.21.15.73:0/2599013759 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95600f08d0 con 0x7f95600cee70 2024-03-24T10:39:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.455 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9558005230 con 0x7f95600cee70 2024-03-24T10:39:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.575 7f9567126700 1 -- 172.21.15.73:0/2599013759 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f95600effa0 con 0x7f95600cee70 2024-03-24T10:39:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.575 7f955cff9700 1 -- 172.21.15.73:0/2599013759 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v17) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9558000c30 con 0x7f95600cee70 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 >> v1:172.21.15.73:6816/43277 conn(0x7f95400145b0 legacy=0x7f9540016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 msgr2=0x7f95601b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 0x7f95601b4620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f95600e1590 tx=0x7f955800c790).stop 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 shutdown_connections 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95600cee70 0x7f95601b4620 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95600c4e70 0x7f95600ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 --2- 172.21.15.73:0/2599013759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95600cea20 0x7f95601b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 >> 172.21.15.73:0/2599013759 conn(0x7f95600dc700 msgr2=0x7f95600d84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 shutdown_connections 2024-03-24T10:39:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.576 7f9567126700 1 -- 172.21.15.73:0/2599013759 wait complete. 2024-03-24T10:39:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-24T10:39:50.587 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-24T10:39:50.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:50.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-24T10:39:50.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-03-24T10:39:50.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:50.668 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-24T10:39:50.731 INFO:tasks.cephfs.cephfs_test_case:[] 2024-03-24T10:39:50.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.857 7f2be2fc2700 1 Processor -- start 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.857 7f2be2fc2700 1 -- start start 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2be2fc2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2be2fc2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 0x7f2bdc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2be2fc2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc1a0a70 con 0x7f2bdc10bb90 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2be2fc2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0fa590 con 0x7f2bdc10b740 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2be2fc2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1a0c90 con 0x7f2bdc0f5a10 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46180/0 (socket says 172.21.15.73:46180) 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdb7fe700 1 -- 172.21.15.73:0/3970517820 learned_addr learned my addr 172.21.15.73:0/3970517820 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdaffd700 1 --2- 172.21.15.73:0/3970517820 >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 0x7f2bdc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdb7fe700 1 -- 172.21.15.73:0/3970517820 >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 msgr2=0x7f2bdc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.858 7f2bdb7fe700 1 --2- 172.21.15.73:0/3970517820 >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 0x7f2bdc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bdb7fe700 1 -- 172.21.15.73:0/3970517820 >> v1:172.21.15.73:6789/0 conn(0x7f2bdc10bb90 legacy=0x7f2bdc1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bda7fc700 1 -- 172.21.15.73:0/3970517820 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688712513 0 0) 0x7f2bd4001490 con 0x7f2bdc10bb90 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bdb7fe700 1 -- 172.21.15.73:0/3970517820 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc1a93d0 con 0x7f2bdc0f5a10 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bdaffd700 1 --2- 172.21.15.73:0/3970517820 >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 0x7f2bdc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bdb7fe700 1 --2- 172.21.15.73:0/3970517820 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2bcc002f70 tx=0x7f2bcc0099d0).ready entity=mon.2 client_cookie=4ebf4cd3a79dc702 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bda7fc700 1 -- 172.21.15.73:0/3970517820 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2bdc1a93d0 con 0x7f2bdc0f5a10 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bda7fc700 1 -- 172.21.15.73:0/3970517820 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00f510 con 0x7f2bdc0f5a10 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2bda7fc700 1 -- 172.21.15.73:0/3970517820 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2bcc00f6f0 con 0x7f2bdc0f5a10 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 -- 172.21.15.73:0/3970517820 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 msgr2=0x7f2bdc10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 --2- 172.21.15.73:0/3970517820 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2bcc002f70 tx=0x7f2bcc0099d0).stop 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 -- 172.21.15.73:0/3970517820 shutdown_connections 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 --2- 172.21.15.73:0/3970517820 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0f5a10 0x7f2bdc10b110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 --2- 172.21.15.73:0/3970517820 >> v2:172.21.15.73:3300/0 conn(0x7f2bdc10b740 0x7f2bdc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 -- 172.21.15.73:0/3970517820 >> 172.21.15.73:0/3970517820 conn(0x7f2bdc113a70 msgr2=0x7f2bdc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.859 7f2be2fc2700 1 -- 172.21.15.73:0/3970517820 shutdown_connections 2024-03-24T10:39:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.860 7f2be2fc2700 1 -- 172.21.15.73:0/3970517820 wait complete. 2024-03-24T10:39:50.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.882 7f2be2fc2700 1 Processor -- start 2024-03-24T10:39:50.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.882 7f2be2fc2700 1 -- start start 2024-03-24T10:39:50.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 0x7f2bdc1ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 0x7f2bdc1addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0e6600 con 0x7f2bdc0f1ec0 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0ddc30 con 0x7f2bdc0f2310 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2be2fc2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0db460 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 0x7f2bdc1ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46190/0 (socket says 172.21.15.73:46190) 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 -- 172.21.15.73:0/1277660597 learned_addr learned my addr 172.21.15.73:0/1277660597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdbfff700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 0x7f2bdc1addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 -- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 msgr2=0x7f2bdc1addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 0x7f2bdc1addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 -- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 msgr2=0x7f2bdc1ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:50.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 0x7f2bdc1ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 -- 172.21.15.73:0/1277660597 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0dbb30 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdbfff700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 0x7f2bdc1addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdaffd700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 0x7f2bdc1ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bdb7fe700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2bdc0c2dc0 tx=0x7f2bcc0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.883 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2bdc0dbb30 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00fe10 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc1ae3f0 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2bcc011bd0 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc1bba00 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2bcc027460 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.884 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2bcc001790 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.885 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0f08e0 con 0x7f2bdc0db6e0 2024-03-24T10:39:50.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:50.888 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2bcc0117d0 con 0x7f2bdc0db6e0 2024-03-24T10:39:51.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.022 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bdc0e2430 con 0x7f2bdc0db6e0 2024-03-24T10:39:51.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.023 7f2bd8ff9700 1 -- 172.21.15.73:0/1277660597 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f2bcc00f300 con 0x7f2bdc0db6e0 2024-03-24T10:39:51.023 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:51.023 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:51.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 >> v1:172.21.15.73:6816/43277 conn(0x7f2bbc0145b0 legacy=0x7f2bbc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 msgr2=0x7f2bdc0f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2bdc0c2dc0 tx=0x7f2bcc0068c0).stop 2024-03-24T10:39:51.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 shutdown_connections 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bdc0f2310 0x7f2bdc1addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2bdc0db6e0 0x7f2bdc0f1890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 --2- 172.21.15.73:0/1277660597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bdc0f1ec0 0x7f2bdc1ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 >> 172.21.15.73:0/1277660597 conn(0x7f2bdc0c8e80 msgr2=0x7f2bdc0d62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 shutdown_connections 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.024 7f2be2fc2700 1 -- 172.21.15.73:0/1277660597 wait complete. 2024-03-24T10:39:51.025 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:51.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:51.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.160 7f390db2b700 1 Processor -- start 2024-03-24T10:39:51.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.160 7f390db2b700 1 -- start start 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3908106530 0x7f390810e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080f1e30 con 0x7f390810eee0 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39080fb670 con 0x7f3908106530 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3908106980 con 0x7f390810ea90 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3908106530 0x7f390810e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46198/0 (socket says 172.21.15.73:46198) 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390705e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f390810eee0 0x7f39080f1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40896/0 (socket says 172.21.15.73:40896) 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390605c700 1 -- 172.21.15.73:0/3762385601 learned_addr learned my addr 172.21.15.73:0/3762385601 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 -- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 msgr2=0x7f39080f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:51.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 -- 172.21.15.73:0/3762385601 >> v1:172.21.15.73:6789/0 conn(0x7f390810eee0 legacy=0x7f39080f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 -- 172.21.15.73:0/3762385601 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39081ac7c0 con 0x7f3908106530 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390585b700 1 -- 172.21.15.73:0/3762385601 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139871929 0 0) 0x7f3900001490 con 0x7f390810eee0 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390605c700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390685d700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3908106530 0x7f390810e460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f39080fb820 tx=0x7f38fc00ba20).ready entity=mon.0 client_cookie=3a631915967c418d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390585b700 1 -- 172.21.15.73:0/3762385601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39081ac7c0 con 0x7f3908106530 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390585b700 1 -- 172.21.15.73:0/3762385601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00d5c0 con 0x7f3908106530 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390585b700 1 -- 172.21.15.73:0/3762385601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f38fc00d990 con 0x7f3908106530 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 -- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3908106530 msgr2=0x7f390810e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.161 7f390db2b700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3908106530 0x7f390810e460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f39080fb820 tx=0x7f38fc00ba20).stop 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 -- 172.21.15.73:0/3762385601 shutdown_connections 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3908106530 0x7f390810e460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 --2- 172.21.15.73:0/3762385601 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f390810ea90 0x7f39080f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 -- 172.21.15.73:0/3762385601 >> 172.21.15.73:0/3762385601 conn(0x7f3908114940 msgr2=0x7f3908114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 -- 172.21.15.73:0/3762385601 shutdown_connections 2024-03-24T10:39:51.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.162 7f390db2b700 1 -- 172.21.15.73:0/3762385601 wait complete. 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 Processor -- start 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 -- start start 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 0x7f39080d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 0x7f39081b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080a85f0 con 0x7f39080d6bd0 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c4660 con 0x7f39080dd4c0 2024-03-24T10:39:51.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390db2b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39081b4da0 con 0x7f39080d6780 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390685d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 0x7f39080d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 0x7f39081b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 0x7f39081b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46210/0 (socket says 172.21.15.73:46210) 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390605c700 1 -- 172.21.15.73:0/2525169282 learned_addr learned my addr 172.21.15.73:0/2525169282 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43930/0 (socket says 172.21.15.73:43930) 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 -- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 msgr2=0x7f39081b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 0x7f39081b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 -- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 msgr2=0x7f39080d6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 0x7f39080d6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.185 7f390705e700 1 -- 172.21.15.73:0/2525169282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39081b4fd0 con 0x7f39080d6bd0 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f390685d700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 0x7f39080d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f390705e700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f39080d77f0 tx=0x7f390000c9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39081b4fd0 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900005af0 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f390db2b700 1 -- 172.21.15.73:0/2525169282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39081bb830 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39000070d0 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f390db2b700 1 -- 172.21.15.73:0/2525169282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39081bbc10 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.186 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f390001b070 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.187 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3900005150 con 0x7f39080d6bd0 2024-03-24T10:39:51.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.187 7f390db2b700 1 -- 172.21.15.73:0/2525169282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39080f08e0 con 0x7f39080d6bd0 2024-03-24T10:39:51.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.190 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f39000058e0 con 0x7f39080d6bd0 2024-03-24T10:39:51.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.296 7f390db2b700 1 -- 172.21.15.73:0/2525169282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39081ae8a0 con 0x7f39080d6bd0 2024-03-24T10:39:51.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.297 7f38f7fff700 1 -- 172.21.15.73:0/2525169282 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f3908115700 con 0x7f39080d6bd0 2024-03-24T10:39:51.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:51.297 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 >> v1:172.21.15.73:6816/43277 conn(0x7f38e40145b0 legacy=0x7f38e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 msgr2=0x7f39081b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f39080d77f0 tx=0x7f390000c9b0).stop 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 shutdown_connections 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39080d6bd0 0x7f39081b4770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39080dd4c0 0x7f39080d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 --2- 172.21.15.73:0/2525169282 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f39080d6780 0x7f39081b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 >> 172.21.15.73:0/2525169282 conn(0x7f39080c55e0 msgr2=0x7f39080c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 shutdown_connections 2024-03-24T10:39:51.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.298 7f390db2b700 1 -- 172.21.15.73:0/2525169282 wait complete. 2024-03-24T10:39:51.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:39:20.092481', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:39:20.674234', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:39:51.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 Processor -- start 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 -- start start 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 0x7f06c810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80f9230 con 0x7f06c80f2310 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c810f0e0 con 0x7f06c80f5920 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06d0597700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81ac680 con 0x7f06c80f1ec0 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06cd392700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06ccb91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 0x7f06c810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06cdb93700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f06c80f2310 0x7f06c810e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40900/0 (socket says 172.21.15.73:40900) 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06cd392700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:54928/0 (socket says 172.21.15.73:54928) 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.437 7f06cdb93700 1 -- 172.21.15.73:0/3863933543 learned_addr learned my addr 172.21.15.73:0/3863933543 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06ccb91700 1 -- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 msgr2=0x7f06c80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06ccb91700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06ccb91700 1 -- 172.21.15.73:0/3863933543 >> v1:172.21.15.73:6789/0 conn(0x7f06c80f2310 legacy=0x7f06c810e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06b7fff700 1 -- 172.21.15.73:0/3863933543 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164695534 0 0) 0x7f06c0001490 con 0x7f06c80f2310 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06ccb91700 1 -- 172.21.15.73:0/3863933543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c81ac830 con 0x7f06c80f1ec0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06cd392700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06ccb91700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 0x7f06c810e2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f06c4002f70 tx=0x7f06c400b9a0).ready entity=mon.2 client_cookie=8d4743774e220381 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06b7fff700 1 -- 172.21.15.73:0/3863933543 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06c81ac830 con 0x7f06c80f1ec0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06b7fff700 1 -- 172.21.15.73:0/3863933543 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400d5c0 con 0x7f06c80f1ec0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06b7fff700 1 -- 172.21.15.73:0/3863933543 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06c400d990 con 0x7f06c80f1ec0 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06d0597700 1 -- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 msgr2=0x7f06c810e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.438 7f06d0597700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 0x7f06c810e2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f06c4002f70 tx=0x7f06c400b9a0).stop 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 -- 172.21.15.73:0/3863933543 shutdown_connections 2024-03-24T10:39:51.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c80f5920 0x7f06c80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 --2- 172.21.15.73:0/3863933543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c80f1ec0 0x7f06c810e2b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 -- 172.21.15.73:0/3863933543 >> 172.21.15.73:0/3863933543 conn(0x7f06c8113a70 msgr2=0x7f06c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 -- 172.21.15.73:0/3863933543 shutdown_connections 2024-03-24T10:39:51.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.439 7f06d0597700 1 -- 172.21.15.73:0/3863933543 wait complete. 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.461 7f06d0597700 1 Processor -- start 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.461 7f06d0597700 1 -- start start 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c81b5610 0x7f06c81bc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80d6d90 con 0x7f06c80cece0 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80d7260 con 0x7f06c81b5610 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81b5a60 con 0x7f06c81b4b90 2024-03-24T10:39:51.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06cd392700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46230/0 (socket says 172.21.15.73:46230) 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06cd392700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43932/0 (socket says 172.21.15.73:43932) 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 -- 172.21.15.73:0/354505192 learned_addr learned my addr 172.21.15.73:0/354505192 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06cdb93700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c81b5610 0x7f06c81bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 -- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c81b5610 msgr2=0x7f06c81bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c81b5610 0x7f06c81bc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 -- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 msgr2=0x7f06c80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 -- 172.21.15.73:0/354505192 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80d7a40 con 0x7f06c81b4b90 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06cd392700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06ccb91700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f06c4002f70 tx=0x7f06c40068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06c80d7a40 con 0x7f06c81b4b90 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c40119c0 con 0x7f06c81b4b90 2024-03-24T10:39:51.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06d0597700 1 -- 172.21.15.73:0/354505192 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c81bc640 con 0x7f06c81b4b90 2024-03-24T10:39:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.462 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06c4017040 con 0x7f06c81b4b90 2024-03-24T10:39:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.463 7f06d0597700 1 -- 172.21.15.73:0/354505192 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c81bc840 con 0x7f06c81b4b90 2024-03-24T10:39:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.463 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f06c40273b0 con 0x7f06c81b4b90 2024-03-24T10:39:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.463 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f06c4018070 con 0x7f06c81b4b90 2024-03-24T10:39:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.464 7f06d0597700 1 -- 172.21.15.73:0/354505192 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c80f08e0 con 0x7f06c81b4b90 2024-03-24T10:39:51.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.467 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f06c400d3b0 con 0x7f06c81b4b90 2024-03-24T10:39:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.572 7f06d0597700 1 -- 172.21.15.73:0/354505192 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06c80cf8b0 con 0x7f06c81b4b90 2024-03-24T10:39:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.573 7f06b67fc700 1 -- 172.21.15.73:0/354505192 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06c40117b0 con 0x7f06c81b4b90 2024-03-24T10:39:51.573 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:39:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 >> v1:172.21.15.73:6816/43277 conn(0x7f06a80145b0 legacy=0x7f06a8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 msgr2=0x7f06c81b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f06c4002f70 tx=0x7f06c40068c0).stop 2024-03-24T10:39:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 shutdown_connections 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06c81b5610 0x7f06c81bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06c80cece0 0x7f06c80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 --2- 172.21.15.73:0/354505192 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06c81b4b90 0x7f06c81b4fe0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 >> 172.21.15.73:0/354505192 conn(0x7f06c80dce40 msgr2=0x7f06c80c1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 shutdown_connections 2024-03-24T10:39:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.574 7f06d0597700 1 -- 172.21.15.73:0/354505192 wait complete. 2024-03-24T10:39:51.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:39:51.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.714 7f1d5970d700 1 Processor -- start 2024-03-24T10:39:51.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.714 7f1d5970d700 1 -- start start 2024-03-24T10:39:51.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.714 7f1d5970d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 0x7f1d540f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.714 7f1d5970d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 0x7f1d5410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d5970d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540f9230 con 0x7f1d540f2310 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d5970d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5410f0e0 con 0x7f1d540f1ec0 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d5970d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541ac680 con 0x7f1d540f5920 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d51ceb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 0x7f1d5410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d52ced700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1d540f2310 0x7f1d5410e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40914/0 (socket says 172.21.15.73:40914) 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 0x7f1d540f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d52ced700 1 -- 172.21.15.73:0/274349603 learned_addr learned my addr 172.21.15.73:0/274349603 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 -- 172.21.15.73:0/274349603 >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 msgr2=0x7f1d5410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 --2- 172.21.15.73:0/274349603 >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 0x7f1d5410e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 -- 172.21.15.73:0/274349603 >> v1:172.21.15.73:6789/0 conn(0x7f1d540f2310 legacy=0x7f1d5410e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 -- 172.21.15.73:0/274349603 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d541ac830 con 0x7f1d540f5920 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d514ea700 1 -- 172.21.15.73:0/274349603 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192457235 0 0) 0x7f1d4c001490 con 0x7f1d540f2310 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d51ceb700 1 --2- 172.21.15.73:0/274349603 >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 0x7f1d5410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d524ec700 1 --2- 172.21.15.73:0/274349603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 0x7f1d540f1890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1d48002f70 tx=0x7f1d4800b970).ready entity=mon.1 client_cookie=745efe7e3fb20bae server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d514ea700 1 -- 172.21.15.73:0/274349603 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d541ac830 con 0x7f1d540f5920 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d514ea700 1 -- 172.21.15.73:0/274349603 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800d5c0 con 0x7f1d540f5920 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d514ea700 1 -- 172.21.15.73:0/274349603 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d4800d990 con 0x7f1d540f5920 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d5970d700 1 -- 172.21.15.73:0/274349603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 msgr2=0x7f1d540f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.715 7f1d5970d700 1 --2- 172.21.15.73:0/274349603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 0x7f1d540f1890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1d48002f70 tx=0x7f1d4800b970).stop 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 -- 172.21.15.73:0/274349603 shutdown_connections 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 --2- 172.21.15.73:0/274349603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d540f5920 0x7f1d540f1890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 --2- 172.21.15.73:0/274349603 >> v2:172.21.15.73:3300/0 conn(0x7f1d540f1ec0 0x7f1d5410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 -- 172.21.15.73:0/274349603 >> 172.21.15.73:0/274349603 conn(0x7f1d54113a70 msgr2=0x7f1d540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 -- 172.21.15.73:0/274349603 shutdown_connections 2024-03-24T10:39:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.716 7f1d5970d700 1 -- 172.21.15.73:0/274349603 wait complete. 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 Processor -- start 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 -- start start 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540cb0d0 con 0x7f1d541b4420 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540cadd0 con 0x7f1d541b9d20 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d5970d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540da080 con 0x7f1d541b3fd0 2024-03-24T10:39:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d524ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d52ced700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d524ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46232/0 (socket says 172.21.15.73:46232) 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d524ec700 1 -- 172.21.15.73:0/1316066535 learned_addr learned my addr 172.21.15.73:0/1316066535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d52ced700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:54958/0 (socket says 172.21.15.73:54958) 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43950/0 (socket says 172.21.15.73:43950) 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 -- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 msgr2=0x7f1d540c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 -- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 msgr2=0x7f1d541bc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d51ceb700 1 -- 172.21.15.73:0/1316066535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540bc500 con 0x7f1d541b4420 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d524ec700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.739 7f1d52ced700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d51ceb700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1d540cce10 tx=0x7f1d4400ebc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d540bc500 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44010780 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540ca8b0 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d4400f040 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541bc990 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1d44011070 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.740 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1d44010040 con 0x7f1d541b4420 2024-03-24T10:39:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.741 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d540f08e0 con 0x7f1d541b4420 2024-03-24T10:39:51.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.744 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1d44010380 con 0x7f1d541b4420 2024-03-24T10:39:51.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.848 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d540d64e0 con 0x7f1d541b4420 2024-03-24T10:39:51.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.849 7f1d437fe700 1 -- 172.21.15.73:0/1316066535 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d44000c30 con 0x7f1d541b4420 2024-03-24T10:39:51.849 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:51.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 >> v1:172.21.15.73:6816/43277 conn(0x7f1d300145b0 legacy=0x7f1d30016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 msgr2=0x7f1d540ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1d540cce10 tx=0x7f1d4400ebc0).stop 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 shutdown_connections 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d541b9d20 0x7f1d541bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1d541b3fd0 0x7f1d540c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 --2- 172.21.15.73:0/1316066535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d541b4420 0x7f1d540ca280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 >> 172.21.15.73:0/1316066535 conn(0x7f1d540dca30 msgr2=0x7f1d540d8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 shutdown_connections 2024-03-24T10:39:51.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.850 7f1d5970d700 1 -- 172.21.15.73:0/1316066535 wait complete. 2024-03-24T10:39:51.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:39:51.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.989 7fdb0f500700 1 Processor -- start 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.989 7fdb0f500700 1 -- start start 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.989 7fdb0f500700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 0x7fdb080f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080f9230 con 0x7fdb080f1ec0 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0810ef10 con 0x7fdb080f2310 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081aa660 con 0x7fdb080f5920 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb077fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0cafc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 0x7fdb080f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0cafc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:54964/0 (socket says 172.21.15.73:54964) 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb077fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43962/0 (socket says 172.21.15.73:43962) 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0cafc700 1 -- 172.21.15.73:0/4067777248 learned_addr learned my addr 172.21.15.73:0/4067777248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:51.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 -- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 msgr2=0x7fdb0810e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 -- 172.21.15.73:0/4067777248 >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 msgr2=0x7fdb0810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 --2- 172.21.15.73:0/4067777248 >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 -- 172.21.15.73:0/4067777248 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb081aa810 con 0x7fdb080f5920 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb077fe700 1 --2- 172.21.15.73:0/4067777248 >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0cafc700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb07fff700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 0x7fdb080f1890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf800b970).ready entity=mon.2 client_cookie=22c70b2ee842ade9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb06ffd700 1 -- 172.21.15.73:0/4067777248 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb081aa810 con 0x7fdb080f5920 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb06ffd700 1 -- 172.21.15.73:0/4067777248 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800d570 con 0x7fdb080f5920 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb06ffd700 1 -- 172.21.15.73:0/4067777248 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdaf800d940 con 0x7fdb080f5920 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 -- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 msgr2=0x7fdb080f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.990 7fdb0f500700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 0x7fdb080f1890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdaf8002f70 tx=0x7fdaf800b970).stop 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 -- 172.21.15.73:0/4067777248 shutdown_connections 2024-03-24T10:39:51.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080f2310 0x7fdb0810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 --2- 172.21.15.73:0/4067777248 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080f5920 0x7fdb080f1890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 --2- 172.21.15.73:0/4067777248 >> v2:172.21.15.73:3300/0 conn(0x7fdb080f1ec0 0x7fdb0810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:51.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 -- 172.21.15.73:0/4067777248 >> 172.21.15.73:0/4067777248 conn(0x7fdb08113a70 msgr2=0x7fdb080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:51.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 -- 172.21.15.73:0/4067777248 shutdown_connections 2024-03-24T10:39:51.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:51.991 7fdb0f500700 1 -- 172.21.15.73:0/4067777248 wait complete. 2024-03-24T10:39:52.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.013 7fdb0f500700 1 Processor -- start 2024-03-24T10:39:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.013 7fdb0f500700 1 -- start start 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080d5c20 0x7fdb080cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080d5560 con 0x7fdb080cfe80 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080d4e80 con 0x7fdb080d5c20 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0f500700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080d50b0 con 0x7fdb080cfa30 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb077fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43968/0 (socket says 172.21.15.73:43968) 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb077fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46242/0 (socket says 172.21.15.73:46242) 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 -- 172.21.15.73:0/2202033414 learned_addr learned my addr 172.21.15.73:0/2202033414 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb07fff700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080d5c20 0x7fdb080cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 -- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 msgr2=0x7fdb081b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 -- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080d5c20 msgr2=0x7fdb080cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080d5c20 0x7fdb080cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 -- 172.21.15.73:0/2202033414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb081b50f0 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb077fe700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.014 7fdb0cafc700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdb080bfa30 tx=0x7fdb0000eda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb081b50f0 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000c880 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb081b5410 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb0000f040 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb081bbd60 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdb00022060 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.015 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fdb00010040 con 0x7fdb080cfe80 2024-03-24T10:39:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.016 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb080f08e0 con 0x7fdb080cfe80 2024-03-24T10:39:52.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.019 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdb0000c670 con 0x7fdb080cfe80 2024-03-24T10:39:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.123 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb081aeb20 con 0x7fdb080cfe80 2024-03-24T10:39:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.123 7fdb057fa700 1 -- 172.21.15.73:0/2202033414 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb081145f0 con 0x7fdb080cfe80 2024-03-24T10:39:52.124 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:39:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 >> v1:172.21.15.73:6816/43277 conn(0x7fdae80145b0 legacy=0x7fdae8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 msgr2=0x7fdb081b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdb080bfa30 tx=0x7fdb0000eda0).stop 2024-03-24T10:39:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 shutdown_connections 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb080cfe80 0x7fdb081b4ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb080d5c20 0x7fdb080cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 --2- 172.21.15.73:0/2202033414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdb080cfa30 0x7fdb081b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 >> 172.21.15.73:0/2202033414 conn(0x7fdb080de680 msgr2=0x7fdb080d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 shutdown_connections 2024-03-24T10:39:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.125 7fdb0f500700 1 -- 172.21.15.73:0/2202033414 wait complete. 2024-03-24T10:39:52.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:52.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 Processor -- start 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 -- start start 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 0x7ffae010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae00f9230 con 0x7ffae00f2310 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae010f0e0 con 0x7ffae00f1ec0 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffae517b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffae01ac680 con 0x7ffae00f5920 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.263 7ffadddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffad7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 0x7ffae010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46254/0 (socket says 172.21.15.73:46254) 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffade5fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffae00f2310 0x7ffae010e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40924/0 (socket says 172.21.15.73:40924) 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 -- 172.21.15.73:0/138210178 learned_addr learned my addr 172.21.15.73:0/138210178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 -- 172.21.15.73:0/138210178 >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 msgr2=0x7ffae010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 --2- 172.21.15.73:0/138210178 >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 0x7ffae010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 -- 172.21.15.73:0/138210178 >> v1:172.21.15.73:6789/0 conn(0x7ffae00f2310 legacy=0x7ffae010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 -- 172.21.15.73:0/138210178 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae01ac830 con 0x7ffae00f5920 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffad7fff700 1 --2- 172.21.15.73:0/138210178 >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 0x7ffae010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadddfc700 1 --2- 172.21.15.73:0/138210178 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffad0002f70 tx=0x7ffad00099d0).ready entity=mon.2 client_cookie=b9380f1b39f23ba1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadd5fb700 1 -- 172.21.15.73:0/138210178 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffae01ac830 con 0x7ffae00f5920 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadd5fb700 1 -- 172.21.15.73:0/138210178 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000f510 con 0x7ffae00f5920 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.264 7ffadd5fb700 1 -- 172.21.15.73:0/138210178 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffad000f6f0 con 0x7ffae00f5920 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 -- 172.21.15.73:0/138210178 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 msgr2=0x7ffae00f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 --2- 172.21.15.73:0/138210178 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffad0002f70 tx=0x7ffad00099d0).stop 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 -- 172.21.15.73:0/138210178 shutdown_connections 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 --2- 172.21.15.73:0/138210178 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae00f5920 0x7ffae00f1890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 --2- 172.21.15.73:0/138210178 >> v2:172.21.15.73:3300/0 conn(0x7ffae00f1ec0 0x7ffae010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 -- 172.21.15.73:0/138210178 >> 172.21.15.73:0/138210178 conn(0x7ffae0113a70 msgr2=0x7ffae00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 -- 172.21.15.73:0/138210178 shutdown_connections 2024-03-24T10:39:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.265 7ffae517b700 1 -- 172.21.15.73:0/138210178 wait complete. 2024-03-24T10:39:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.287 7ffae517b700 1 Processor -- start 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.287 7ffae517b700 1 -- start start 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffae01b4da0 0x7ffae01b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c5b80 con 0x7ffae01b38a0 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00bc950 con 0x7ffae01b4da0 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffae01b5820 con 0x7ffae01b4320 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffadddfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46256/0 (socket says 172.21.15.73:46256) 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffadddfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43998/0 (socket says 172.21.15.73:43998) 2024-03-24T10:39:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 -- 172.21.15.73:0/832432950 learned_addr learned my addr 172.21.15.73:0/832432950 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffade5fd700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffae01b4da0 0x7ffae01b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 -- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffae01b4da0 msgr2=0x7ffae01b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffae01b4da0 0x7ffae01b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 -- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 msgr2=0x7ffae01b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 -- 172.21.15.73:0/832432950 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00c4f30 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffadddfc700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad7fff700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ffae00d9cf0 tx=0x7ffac800eb70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffae00c4f30 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800c810 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffac800f040 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 -- 172.21.15.73:0/832432950 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae00d8380 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.288 7ffae517b700 1 -- 172.21.15.73:0/832432950 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae01bc1a0 con 0x7ffae01b4320 2024-03-24T10:39:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.289 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ffac8011070 con 0x7ffae01b4320 2024-03-24T10:39:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.289 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ffac8010040 con 0x7ffae01b4320 2024-03-24T10:39:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.290 7ffae517b700 1 -- 172.21.15.73:0/832432950 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae00f08e0 con 0x7ffae01b4320 2024-03-24T10:39:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.293 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ffac800c410 con 0x7ffae01b4320 2024-03-24T10:39:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.428 7ffae517b700 1 -- 172.21.15.73:0/832432950 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffae00cf2f0 con 0x7ffae01b4320 2024-03-24T10:39:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.428 7ffad6ffd700 1 -- 172.21.15.73:0/832432950 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7ffac802a6c0 con 0x7ffae01b4320 2024-03-24T10:39:52.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:52.429 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 -- 172.21.15.73:0/832432950 >> v1:172.21.15.73:6816/43277 conn(0x7ffac40145b0 legacy=0x7ffac4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 -- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 msgr2=0x7ffae01b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ffae00d9cf0 tx=0x7ffac800eb70).stop 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 -- 172.21.15.73:0/832432950 shutdown_connections 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffae01b4da0 0x7ffae01b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffae01b38a0 0x7ffae01b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 --2- 172.21.15.73:0/832432950 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ffae01b4320 0x7ffae01b4770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.429 7ffae517b700 1 -- 172.21.15.73:0/832432950 >> 172.21.15.73:0/832432950 conn(0x7ffae00dcac0 msgr2=0x7ffae00d8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.430 7ffae517b700 1 -- 172.21.15.73:0/832432950 shutdown_connections 2024-03-24T10:39:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.430 7ffae517b700 1 -- 172.21.15.73:0/832432950 wait complete. 2024-03-24T10:39:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:52.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:52.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.566 7f957f4e9700 1 Processor -- start 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.566 7f957f4e9700 1 -- start start 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 0x7f95781a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95781a8c80 0x7f95781ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95780f9230 con 0x7f95780f5920 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95780f24e0 con 0x7f95781a8c80 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780f26e0 con 0x7f95780f2090 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 0x7f95781a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9577fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95780f5920 0x7f95780f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40938/0 (socket says 172.21.15.73:40938) 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9577fff700 1 -- 172.21.15.73:0/2629513197 learned_addr learned my addr 172.21.15.73:0/2629513197 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957cae5700 1 --2- 172.21.15.73:0/2629513197 >> v2:172.21.15.73:3300/0 conn(0x7f95781a8c80 0x7f95781ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 -- 172.21.15.73:0/2629513197 >> v2:172.21.15.73:3300/0 conn(0x7f95781a8c80 msgr2=0x7f95781ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 --2- 172.21.15.73:0/2629513197 >> v2:172.21.15.73:3300/0 conn(0x7f95781a8c80 0x7f95781ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 -- 172.21.15.73:0/2629513197 >> v1:172.21.15.73:6789/0 conn(0x7f95780f5920 legacy=0x7f95780f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9576ffd700 1 -- 172.21.15.73:0/2629513197 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490670171 0 0) 0x7f956c001110 con 0x7f95780f5920 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 -- 172.21.15.73:0/2629513197 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95781ac720 con 0x7f95780f2090 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f95777fe700 1 --2- 172.21.15.73:0/2629513197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 0x7f95781a8650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9568002f70 tx=0x7f956800b970).ready entity=mon.1 client_cookie=58f33099282bfab6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9576ffd700 1 -- 172.21.15.73:0/2629513197 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95781ac720 con 0x7f95780f2090 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9576ffd700 1 -- 172.21.15.73:0/2629513197 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800d5c0 con 0x7f95780f2090 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f9576ffd700 1 -- 172.21.15.73:0/2629513197 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f956800d9e0 con 0x7f95780f2090 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 -- 172.21.15.73:0/2629513197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 msgr2=0x7f95781a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.567 7f957f4e9700 1 --2- 172.21.15.73:0/2629513197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 0x7f95781a8650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9568002f70 tx=0x7f956800b970).stop 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 -- 172.21.15.73:0/2629513197 shutdown_connections 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 --2- 172.21.15.73:0/2629513197 >> v2:172.21.15.73:3300/0 conn(0x7f95781a8c80 0x7f95781ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 --2- 172.21.15.73:0/2629513197 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95780f2090 0x7f95781a8650 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 -- 172.21.15.73:0/2629513197 >> 172.21.15.73:0/2629513197 conn(0x7f9578113a70 msgr2=0x7f95780f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 -- 172.21.15.73:0/2629513197 shutdown_connections 2024-03-24T10:39:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.568 7f957f4e9700 1 -- 172.21.15.73:0/2629513197 wait complete. 2024-03-24T10:39:52.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.590 7f957f4e9700 1 Processor -- start 2024-03-24T10:39:52.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 -- start start 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 0x7f95781a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 0x7f95781b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780c8000 con 0x7f95781a7aa0 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780de4e0 con 0x7f95781b49b0 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957f4e9700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95780e05d0 con 0x7f95781a7020 2024-03-24T10:39:52.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f9577fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 0x7f95781a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44030/0 (socket says 172.21.15.73:44030) 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957cae5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 0x7f95781b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f9577fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 0x7f95781a7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46264/0 (socket says 172.21.15.73:46264) 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 -- 172.21.15.73:0/3987452728 learned_addr learned my addr 172.21.15.73:0/3987452728 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 -- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 msgr2=0x7f95781a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 0x7f95781a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 -- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 msgr2=0x7f95781b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 0x7f95781b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f95777fe700 1 -- 172.21.15.73:0/3987452728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780e0010 con 0x7f95781a7aa0 2024-03-24T10:39:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.591 7f957cae5700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 0x7f95781b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95777fe700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95780e08e0 tx=0x7f95680068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f95780e0010 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680119c0 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95781bbb00 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9568017040 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95781bbee0 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9568026360 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.592 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9568018070 con 0x7f95781a7aa0 2024-03-24T10:39:52.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.593 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95780f08e0 con 0x7f95781a7aa0 2024-03-24T10:39:52.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.596 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f95680117b0 con 0x7f95781a7aa0 2024-03-24T10:39:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.701 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95780c6170 con 0x7f95781a7aa0 2024-03-24T10:39:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.701 7f95757fa700 1 -- 172.21.15.73:0/3987452728 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f956800d3b0 con 0x7f95781a7aa0 2024-03-24T10:39:52.702 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:52.702 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 >> v1:172.21.15.73:6816/43277 conn(0x7f95580145b0 legacy=0x7f9558016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 msgr2=0x7f95781b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95780e08e0 tx=0x7f95680068c0).stop 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 shutdown_connections 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95781b49b0 0x7f95781b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f95781a7020 0x7f95781a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 --2- 172.21.15.73:0/3987452728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95781a7aa0 0x7f95781b4380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 >> 172.21.15.73:0/3987452728 conn(0x7f95780ca0d0 msgr2=0x7f95781a83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 shutdown_connections 2024-03-24T10:39:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.703 7f957f4e9700 1 -- 172.21.15.73:0/3987452728 wait complete. 2024-03-24T10:39:52.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-24T10:39:52.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.840 7f1623f91700 1 Processor -- start 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.840 7f1623f91700 1 -- start start 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.840 7f1623f91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.840 7f1623f91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.840 7f1623f91700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1623f91700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0f91b0 con 0x7f161c0f2290 2024-03-24T10:39:52.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1623f91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c10ee90 con 0x7f161c0f1e40 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1623f91700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1aa5e0 con 0x7f161c0f58a0 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f162158d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1613fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f162158d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44044/0 (socket says 172.21.15.73:44044) 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1613fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55012/0 (socket says 172.21.15.73:55012) 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46276/0 (socket says 172.21.15.73:46276) 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f162158d700 1 -- 172.21.15.73:0/986392694 learned_addr learned my addr 172.21.15.73:0/986392694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 -- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 msgr2=0x7f161c10e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 -- 172.21.15.73:0/986392694 >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 msgr2=0x7f161c10e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 --2- 172.21.15.73:0/986392694 >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 -- 172.21.15.73:0/986392694 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c1aa790 con 0x7f161c0f58a0 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f162158d700 1 --2- 172.21.15.73:0/986392694 >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1613fff700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1620d8c700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1618002f70 tx=0x7f161800b970).ready entity=mon.2 client_cookie=d08cbe784e2a1ebe server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f16137fe700 1 -- 172.21.15.73:0/986392694 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f161c1aa790 con 0x7f161c0f58a0 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f16137fe700 1 -- 172.21.15.73:0/986392694 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800d570 con 0x7f161c0f58a0 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f16137fe700 1 -- 172.21.15.73:0/986392694 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f161800d940 con 0x7f161c0f58a0 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1623f91700 1 -- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 msgr2=0x7f161c0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.841 7f1623f91700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1618002f70 tx=0x7f161800b970).stop 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 -- 172.21.15.73:0/986392694 shutdown_connections 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 --2- 172.21.15.73:0/986392694 >> v2:172.21.15.73:3300/0 conn(0x7f161c0f2290 0x7f161c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c0f58a0 0x7f161c0f1810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 --2- 172.21.15.73:0/986392694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0f1e40 0x7f161c10e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 -- 172.21.15.73:0/986392694 >> 172.21.15.73:0/986392694 conn(0x7f161c1139f0 msgr2=0x7f161c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 -- 172.21.15.73:0/986392694 shutdown_connections 2024-03-24T10:39:52.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.842 7f1623f91700 1 -- 172.21.15.73:0/986392694 wait complete. 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.864 7f1623f91700 1 Processor -- start 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 -- start start 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 0x7f161c1b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0effc0 con 0x7f161c0cce50 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0be650 con 0x7f161c0cc3d0 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1623f91700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0d89c0 con 0x7f161c1b4ab0 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1620d8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1613fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1613fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44050/0 (socket says 172.21.15.73:44050) 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1620d8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55018/0 (socket says 172.21.15.73:55018) 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1613fff700 1 -- 172.21.15.73:0/3398758405 learned_addr learned my addr 172.21.15.73:0/3398758405 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 0x7f161c1b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 -- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 msgr2=0x7f161c0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 -- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 msgr2=0x7f161c1b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f162158d700 1 -- 172.21.15.73:0/3398758405 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c1bbbf0 con 0x7f161c1b4ab0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1613fff700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.865 7f1620d8c700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f162158d700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 0x7f161c1b4f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f161c0bec10 tx=0x7f1614009680).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f161c1bbbf0 con 0x7f161c1b4ab0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400c830 con 0x7f161c1b4ab0 2024-03-24T10:39:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1623f91700 1 -- 172.21.15.73:0/3398758405 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c1bbdf0 con 0x7f161c1b4ab0 2024-03-24T10:39:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f161400f040 con 0x7f161c1b4ab0 2024-03-24T10:39:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1623f91700 1 -- 172.21.15.73:0/3398758405 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c1bbff0 con 0x7f161c1b4ab0 2024-03-24T10:39:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1614022060 con 0x7f161c1b4ab0 2024-03-24T10:39:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.866 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1614010040 con 0x7f161c1b4ab0 2024-03-24T10:39:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.867 7f1623f91700 1 -- 172.21.15.73:0/3398758405 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c0f0860 con 0x7f161c1b4ab0 2024-03-24T10:39:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:52.870 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f161400c620 con 0x7f161c1b4ab0 2024-03-24T10:39:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.004 7f1623f91700 1 -- 172.21.15.73:0/3398758405 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f161c0d9f10 con 0x7f161c1b4ab0 2024-03-24T10:39:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.005 7f1611ffb700 1 -- 172.21.15.73:0/3398758405 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f16140296c0 con 0x7f161c1b4ab0 2024-03-24T10:39:53.005 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:53.005 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 >> v1:172.21.15.73:6816/43277 conn(0x7f15fc0145b0 legacy=0x7f15fc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 msgr2=0x7f161c1b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 0x7f161c1b4f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f161c0bec10 tx=0x7f1614009680).stop 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 shutdown_connections 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f161c1b4ab0 0x7f161c1b4f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f161c0cc3d0 0x7f161c0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 --2- 172.21.15.73:0/3398758405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f161c0cce50 0x7f161c1b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 >> 172.21.15.73:0/3398758405 conn(0x7f161c0de750 msgr2=0x7f161c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 shutdown_connections 2024-03-24T10:39:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.006 7f1623f91700 1 -- 172.21.15.73:0/3398758405 wait complete. 2024-03-24T10:39:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:53.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:39:53.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 Processor -- start 2024-03-24T10:39:53.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 -- start start 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 0x7f1e8810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880f9230 con 0x7f1e880f5920 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8810ef10 con 0x7f1e880f1ec0 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e8d0a6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881aa660 con 0x7f1e880f2310 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e855fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 0x7f1e8810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e865fd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e85dfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e865fd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46288/0 (socket says 172.21.15.73:46288) 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e85dfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44064/0 (socket says 172.21.15.73:44064) 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e855fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 0x7f1e8810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55020/0 (socket says 172.21.15.73:55020) 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.143 7f1e865fd700 1 -- 172.21.15.73:0/2882955745 learned_addr learned my addr 172.21.15.73:0/2882955745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 -- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 msgr2=0x7f1e8810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 --2- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 0x7f1e8810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 -- 172.21.15.73:0/2882955745 >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 msgr2=0x7f1e880f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 --2- 172.21.15.73:0/2882955745 >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 -- 172.21.15.73:0/2882955745 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e881aa810 con 0x7f1e880f2310 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e85dfc700 1 --2- 172.21.15.73:0/2882955745 >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e865fd700 1 --2- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1e800032f0 tx=0x7f1e80009d60).ready entity=mon.2 client_cookie=13083efbb89d7e05 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e84dfa700 1 -- 172.21.15.73:0/2882955745 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e881aa810 con 0x7f1e880f2310 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e84dfa700 1 -- 172.21.15.73:0/2882955745 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000b880 con 0x7f1e880f2310 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e84dfa700 1 -- 172.21.15.73:0/2882955745 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e8000ba60 con 0x7f1e880f2310 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e8d0a6700 1 -- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 msgr2=0x7f1e8810e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e8d0a6700 1 --2- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1e800032f0 tx=0x7f1e80009d60).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e8d0a6700 1 -- 172.21.15.73:0/2882955745 shutdown_connections 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e8d0a6700 1 --2- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880f2310 0x7f1e8810e8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.144 7f1e8d0a6700 1 --2- 172.21.15.73:0/2882955745 >> v2:172.21.15.73:3300/0 conn(0x7f1e880f5920 0x7f1e880f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.145 7f1e8d0a6700 1 --2- 172.21.15.73:0/2882955745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e880f1ec0 0x7f1e8810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.145 7f1e8d0a6700 1 -- 172.21.15.73:0/2882955745 >> 172.21.15.73:0/2882955745 conn(0x7f1e88113a70 msgr2=0x7f1e880f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.145 7f1e8d0a6700 1 -- 172.21.15.73:0/2882955745 shutdown_connections 2024-03-24T10:39:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.145 7f1e8d0a6700 1 -- 172.21.15.73:0/2882955745 wait complete. 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.167 7f1e8d0a6700 1 Processor -- start 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.167 7f1e8d0a6700 1 -- start start 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 0x7f1e880cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 0x7f1e881b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e881b4c90 0x7f1e881b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880d9d50 con 0x7f1e880cce50 2024-03-24T10:39:53.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880be830 con 0x7f1e881b4c90 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881b5710 con 0x7f1e880cc3d0 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e85dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 0x7f1e880cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 0x7f1e881b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e865fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e881b4c90 0x7f1e881b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e85dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 0x7f1e880cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46300/0 (socket says 172.21.15.73:46300) 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e85dfc700 1 -- 172.21.15.73:0/3333594201 learned_addr learned my addr 172.21.15.73:0/3333594201 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 -- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 msgr2=0x7f1e880cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 0x7f1e880cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 -- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e881b4c90 msgr2=0x7f1e881b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e881b4c90 0x7f1e881b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 -- 172.21.15.73:0/3333594201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880ddb80 con 0x7f1e880cce50 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e855fb700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 0x7f1e881b4660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1e880cf7f0 tx=0x7f1e7800ec50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e880ddb80 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800c940 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e881bbd50 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1e7800f040 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.168 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e881bc130 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.169 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1e78011070 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.169 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1e78010040 con 0x7f1e880cce50 2024-03-24T10:39:53.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.169 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880f08e0 con 0x7f1e880cce50 2024-03-24T10:39:53.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.173 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1e7800c540 con 0x7f1e880cce50 2024-03-24T10:39:53.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.308 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e88088f20 con 0x7f1e880cce50 2024-03-24T10:39:53.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.309 7f1e76ffd700 1 -- 172.21.15.73:0/3333594201 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1700 (secure 0 0 0) 0x7f1e78000c30 con 0x7f1e880cce50 2024-03-24T10:39:53.309 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:53.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:39:21.708322","modified":"2024-03-24 10:39:23.715352","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4212":{"gid":4212,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6817/319226592","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":319226592}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-24T10:39:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 >> v1:172.21.15.73:6816/43277 conn(0x7f1e640145b0 legacy=0x7f1e64016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 msgr2=0x7f1e881b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 0x7f1e881b4660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1e880cf7f0 tx=0x7f1e7800ec50).stop 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 shutdown_connections 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1e881b4c90 0x7f1e881b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1e880cc3d0 0x7f1e880cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 --2- 172.21.15.73:0/3333594201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e880cce50 0x7f1e881b4660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 >> 172.21.15.73:0/3333594201 conn(0x7f1e880de960 msgr2=0x7f1e880d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 shutdown_connections 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.310 7f1e8d0a6700 1 -- 172.21.15.73:0/3333594201 wait complete. 2024-03-24T10:39:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-24T10:39:53.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 Processor -- start 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 -- start start 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1de80f5a10 0x7f1de810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 0x7f1de81a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de81a0a70 con 0x7f1de810b740 2024-03-24T10:39:53.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80fa590 con 0x7f1de80f5a10 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.447 7f1defb25700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81a0c90 con 0x7f1de810bb90 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1de80f5a10 0x7f1de810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1ded121700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 0x7f1de81a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de7fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1de810b740 0x7f1de819fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40952/0 (socket says 172.21.15.73:40952) 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de7fff700 1 -- 172.21.15.73:0/2881355198 learned_addr learned my addr 172.21.15.73:0/2881355198 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 -- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 msgr2=0x7f1de81a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 0x7f1de81a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 -- 172.21.15.73:0/2881355198 >> v1:172.21.15.73:6789/0 conn(0x7f1de810b740 legacy=0x7f1de819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 -- 172.21.15.73:0/2881355198 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de81a93d0 con 0x7f1de80f5a10 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de77fe700 1 -- 172.21.15.73:0/2881355198 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519471105 0 0) 0x7f1dd4001110 con 0x7f1de810b740 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1ded121700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 0x7f1de81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1dec920700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de80f5a10 0x7f1de810b110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1de8103a10 tx=0x7f1ddc00dc80).ready entity=mon.0 client_cookie=e9dab20e8258a5b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de77fe700 1 -- 172.21.15.73:0/2881355198 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1de81a93d0 con 0x7f1de80f5a10 2024-03-24T10:39:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de77fe700 1 -- 172.21.15.73:0/2881355198 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00bba0 con 0x7f1de80f5a10 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1de77fe700 1 -- 172.21.15.73:0/2881355198 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ddc015070 con 0x7f1de80f5a10 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1defb25700 1 -- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de80f5a10 msgr2=0x7f1de810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.448 7f1defb25700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de80f5a10 0x7f1de810b110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1de8103a10 tx=0x7f1ddc00dc80).stop 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 -- 172.21.15.73:0/2881355198 shutdown_connections 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de810bb90 0x7f1de81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 --2- 172.21.15.73:0/2881355198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de80f5a10 0x7f1de810b110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 -- 172.21.15.73:0/2881355198 >> 172.21.15.73:0/2881355198 conn(0x7f1de8113a70 msgr2=0x7f1de80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 -- 172.21.15.73:0/2881355198 shutdown_connections 2024-03-24T10:39:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.449 7f1defb25700 1 -- 172.21.15.73:0/2881355198 wait complete. 2024-03-24T10:39:53.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.471 7f1defb25700 1 Processor -- start 2024-03-24T10:39:53.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 -- start start 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80da480 con 0x7f1de81b1570 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81b5be0 con 0x7f1de81b5160 2024-03-24T10:39:53.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1defb25700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81b2440 con 0x7f1de81b1ff0 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1de7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1ded121700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1ded121700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55048/0 (socket says 172.21.15.73:55048) 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1de7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46310/0 (socket says 172.21.15.73:46310) 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1ded121700 1 -- 172.21.15.73:0/878415144 learned_addr learned my addr 172.21.15.73:0/878415144 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44104/0 (socket says 172.21.15.73:44104) 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 -- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 msgr2=0x7f1de81b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 -- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 msgr2=0x7f1de81b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.472 7f1dec920700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1dec920700 1 -- 172.21.15.73:0/878415144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de81bc010 con 0x7f1de81b1570 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1ded121700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de7fff700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1dec920700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1de81b5d90 tx=0x7f1ddc0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1de81bc010 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc01a440 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1defb25700 1 -- 172.21.15.73:0/878415144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de81bc210 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ddc01a810 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1defb25700 1 -- 172.21.15.73:0/878415144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de81bc5f0 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1ddc01aa10 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.473 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1ddc01edc0 con 0x7f1de81b1570 2024-03-24T10:39:53.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.474 7f1defb25700 1 -- 172.21.15.73:0/878415144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80f08e0 con 0x7f1de81b1570 2024-03-24T10:39:53.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.477 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1ddc010ad0 con 0x7f1de81b1570 2024-03-24T10:39:53.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.583 7f1defb25700 1 -- 172.21.15.73:0/878415144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1de80dd980 con 0x7f1de81b1570 2024-03-24T10:39:53.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.583 7f1de5ffb700 1 -- 172.21.15.73:0/878415144 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f1ddc00b7a0 con 0x7f1de81b1570 2024-03-24T10:39:53.583 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:53.583 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:37.188821","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:39:20.092481","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24 10:39:20.674234","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.584 7f1defb25700 1 -- 172.21.15.73:0/878415144 >> v1:172.21.15.73:6816/43277 conn(0x7f1dd00145b0 legacy=0x7f1dd0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 -- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 msgr2=0x7f1de81b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1de81b5d90 tx=0x7f1ddc0068c0).stop 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 -- 172.21.15.73:0/878415144 shutdown_connections 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1de81b5160 0x7f1de81b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1de81b1570 0x7f1de81b19c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 --2- 172.21.15.73:0/878415144 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f1de81b1ff0 0x7f1de81b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 -- 172.21.15.73:0/878415144 >> 172.21.15.73:0/878415144 conn(0x7f1de80c4ea0 msgr2=0x7f1de80cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 -- 172.21.15.73:0/878415144 shutdown_connections 2024-03-24T10:39:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.585 7f1defb25700 1 -- 172.21.15.73:0/878415144 wait complete. 2024-03-24T10:39:53.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 Processor -- start 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 -- start start 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 0x7f777810b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f777810b730 0x7f777819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77781a0a60 con 0x7f777810bb80 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780fa580 con 0x7f777810b730 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f77800dc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77781a0c80 con 0x7f77780f5a00 2024-03-24T10:39:53.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f7777fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f777810b730 0x7f777819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f777ced7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 0x7f777810b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f777d6d8700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f777810bb80 0x7f77781a0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40960/0 (socket says 172.21.15.73:40960) 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.723 7f777d6d8700 1 -- 172.21.15.73:0/1669243417 learned_addr learned my addr 172.21.15.73:0/1669243417 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f7777fff700 1 -- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 msgr2=0x7f777810b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f7777fff700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 0x7f777810b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f7777fff700 1 -- 172.21.15.73:0/1669243417 >> v1:172.21.15.73:6789/0 conn(0x7f777810bb80 legacy=0x7f77781a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77777fe700 1 -- 172.21.15.73:0/1669243417 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977986762 0 0) 0x7f7770001490 con 0x7f777810bb80 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f7777fff700 1 -- 172.21.15.73:0/1669243417 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780f1880 con 0x7f777810b730 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f777ced7700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 0x7f777810b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f7777fff700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f777810b730 0x7f777819fc30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7764002f70 tx=0x7f776400b9f0).ready entity=mon.0 client_cookie=af82bf67a3c00ba3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77777fe700 1 -- 172.21.15.73:0/1669243417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77780f1880 con 0x7f777810b730 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77777fe700 1 -- 172.21.15.73:0/1669243417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400d5c0 con 0x7f777810b730 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77777fe700 1 -- 172.21.15.73:0/1669243417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f776400d990 con 0x7f777810b730 2024-03-24T10:39:53.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77800dc700 1 -- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f777810b730 msgr2=0x7f777819fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77800dc700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f777810b730 0x7f777819fc30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7764002f70 tx=0x7f776400b9f0).stop 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77800dc700 1 -- 172.21.15.73:0/1669243417 shutdown_connections 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77800dc700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780f5a00 0x7f777810b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.724 7f77800dc700 1 --2- 172.21.15.73:0/1669243417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f777810b730 0x7f777819fc30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.725 7f77800dc700 1 -- 172.21.15.73:0/1669243417 >> 172.21.15.73:0/1669243417 conn(0x7f7778113a60 msgr2=0x7f77780f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.725 7f77800dc700 1 -- 172.21.15.73:0/1669243417 shutdown_connections 2024-03-24T10:39:53.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.725 7f77800dc700 1 -- 172.21.15.73:0/1669243417 wait complete. 2024-03-24T10:39:53.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.747 7f77800dc700 1 Processor -- start 2024-03-24T10:39:53.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.747 7f77800dc700 1 -- start start 2024-03-24T10:39:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 0x7f77781b6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f77781b6c90 0x7f77781b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780a83c0 con 0x7f77780c1ef0 2024-03-24T10:39:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780bb670 con 0x7f77780c1470 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f77800dc700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77780d5a60 con 0x7f77781b6c90 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f7777fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 0x7f77781b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55066/0 (socket says 172.21.15.73:55066) 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 -- 172.21.15.73:0/2889973315 learned_addr learned my addr 172.21.15.73:0/2889973315 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777d6d8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f77781b6c90 0x7f77781b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 -- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f77781b6c90 msgr2=0x7f77781b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f77781b6c90 0x7f77781b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 -- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 msgr2=0x7f77781b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 0x7f77781b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 -- 172.21.15.73:0/2889973315 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780d57a0 con 0x7f77780c1470 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f7777fff700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 0x7f77781b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.748 7f777ced7700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f776c00c000 tx=0x7f776c00bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f77780d57a0 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c00c9a0 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f77800dc700 1 -- 172.21.15.73:0/2889973315 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780ce190 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f776c00f040 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f77800dc700 1 -- 172.21.15.73:0/2889973315 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780bfdb0 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f776c011070 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.749 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f776c010040 con 0x7f77780c1470 2024-03-24T10:39:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.750 7f77800dc700 1 -- 172.21.15.73:0/2889973315 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77780f08d0 con 0x7f77780c1470 2024-03-24T10:39:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.753 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f776c00c5a0 con 0x7f77780c1470 2024-03-24T10:39:53.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:53.887 7f77800dc700 1 -- 172.21.15.73:0/2889973315 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f77780ab8d0 con 0x7f77780c1470 2024-03-24T10:39:54.204 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-03-24 10:39:54.204 7f1d1ca5e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-24T10:39:54.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.206 7f7775ffb700 1 -- 172.21.15.73:0/2889973315 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f776c000c30 con 0x7f77780c1470 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 -- 172.21.15.73:0/2889973315 >> v1:172.21.15.73:6816/43277 conn(0x7f77600145b0 legacy=0x7f7760016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 -- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 msgr2=0x7f77780c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f776c00c000 tx=0x7f776c00bf70).stop 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 -- 172.21.15.73:0/2889973315 shutdown_connections 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f77781b6c90 0x7f77781b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77780c1470 0x7f77780c18c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 --2- 172.21.15.73:0/2889973315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77780c1ef0 0x7f77781b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.208 7f77800dc700 1 -- 172.21.15.73:0/2889973315 >> 172.21.15.73:0/2889973315 conn(0x7f77780bc590 msgr2=0x7f77780c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.209 7f77800dc700 1 -- 172.21.15.73:0/2889973315 shutdown_connections 2024-03-24T10:39:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.209 7f77800dc700 1 -- 172.21.15.73:0/2889973315 wait complete. 2024-03-24T10:39:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-24T10:39:54.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-24T10:39:54.240 INFO:tasks.ceph.mds.a.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:54.308 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 Processor -- start 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 -- start start 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 0x7f46a80f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 0x7f46a810ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80f91a0 con 0x7f46a80f1e30 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a810f050 con 0x7f46a80f5890 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46addb3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46a81ac5f0 con 0x7f46a80f2280 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46a6ab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 0x7f46a80f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46a62b1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46a80f1e30 0x7f46a810e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40992/0 (socket says 172.21.15.73:40992) 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46a62b1700 1 -- 172.21.15.73:0/1243974754 learned_addr learned my addr 172.21.15.73:0/1243974754 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:54.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.370 7f46a72b3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 0x7f46a810ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a72b3700 1 -- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 msgr2=0x7f46a80f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a72b3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 0x7f46a80f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a5ab0700 1 -- 172.21.15.73:0/1243974754 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270557848 0 0) 0x7f4698001110 con 0x7f46a80f1e30 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a72b3700 1 -- 172.21.15.73:0/1243974754 >> v1:172.21.15.73:6789/0 conn(0x7f46a80f1e30 legacy=0x7f46a810e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a72b3700 1 -- 172.21.15.73:0/1243974754 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a81ac7a0 con 0x7f46a80f2280 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a6ab2700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 0x7f46a80f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a72b3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 0x7f46a810ea20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f46a00032f0 tx=0x7f46a0009cc0).ready entity=mon.2 client_cookie=9fe2abea358120d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a5ab0700 1 -- 172.21.15.73:0/1243974754 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46a81ac7a0 con 0x7f46a80f2280 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a5ab0700 1 -- 172.21.15.73:0/1243974754 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000b880 con 0x7f46a80f2280 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46a5ab0700 1 -- 172.21.15.73:0/1243974754 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46a000ba60 con 0x7f46a80f2280 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46addb3700 1 -- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 msgr2=0x7f46a810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.371 7f46addb3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 0x7f46a810ea20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f46a00032f0 tx=0x7f46a0009cc0).stop 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 -- 172.21.15.73:0/1243974754 shutdown_connections 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80f2280 0x7f46a810ea20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 --2- 172.21.15.73:0/1243974754 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a80f5890 0x7f46a80f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 -- 172.21.15.73:0/1243974754 >> 172.21.15.73:0/1243974754 conn(0x7f46a81139e0 msgr2=0x7f46a80f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:54.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 -- 172.21.15.73:0/1243974754 shutdown_connections 2024-03-24T10:39:54.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.372 7f46addb3700 1 -- 172.21.15.73:0/1243974754 wait complete. 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.394 7f46addb3700 1 Processor -- start 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.394 7f46addb3700 1 -- start start 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a80cace0 0x7f46a81b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a81b4e50 0x7f46a81bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80cf750 con 0x7f46a80cace0 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80bc750 con 0x7f46a81b4e50 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80d6820 con 0x7f46a80ca260 2024-03-24T10:39:54.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46344/0 (socket says 172.21.15.73:46344) 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 -- 172.21.15.73:0/2620322375 learned_addr learned my addr 172.21.15.73:0/2620322375 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a62b1700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a80cace0 0x7f46a81b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a72b3700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a81b4e50 0x7f46a81bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 -- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a81b4e50 msgr2=0x7f46a81bbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a81b4e50 0x7f46a81bbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 -- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a80cace0 msgr2=0x7f46a81b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a80cace0 0x7f46a81b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 -- 172.21.15.73:0/2620322375 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80d76b0 con 0x7f46a80ca260 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46a6ab2700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f46a80d9a00 tx=0x7f469c00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46a80d76b0 con 0x7f46a80ca260 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00ee60 con 0x7f46a80ca260 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 -- 172.21.15.73:0/2620322375 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a81b52a0 con 0x7f46a80ca260 2024-03-24T10:39:54.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f469c00f040 con 0x7f46a80ca260 2024-03-24T10:39:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.395 7f46addb3700 1 -- 172.21.15.73:0/2620322375 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a81bc330 con 0x7f46a80ca260 2024-03-24T10:39:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.396 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f469c011070 con 0x7f46a80ca260 2024-03-24T10:39:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.396 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f469c010040 con 0x7f46a80ca260 2024-03-24T10:39:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.396 7f46addb3700 1 -- 172.21.15.73:0/2620322375 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a80f0850 con 0x7f46a80ca260 2024-03-24T10:39:54.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.399 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f469c00c5c0 con 0x7f46a80ca260 2024-03-24T10:39:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:54.535 7f46addb3700 1 -- 172.21.15.73:0/2620322375 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46a80ceec0 con 0x7f46a80ca260 2024-03-24T10:39:55.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.218 7f4697fff700 1 -- 172.21.15.73:0/2620322375 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f469c000c30 con 0x7f46a80ca260 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 >> v1:172.21.15.73:6816/43277 conn(0x7f46840145b0 legacy=0x7f4684016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 msgr2=0x7f46a80ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f46a80d9a00 tx=0x7f469c00bf70).stop 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 shutdown_connections 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46a81b4e50 0x7f46a81bbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46a80ca260 0x7f46a80ca6b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 --2- 172.21.15.73:0/2620322375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a80cace0 0x7f46a81b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 >> 172.21.15.73:0/2620322375 conn(0x7f46a80bd710 msgr2=0x7f46a80d89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 shutdown_connections 2024-03-24T10:39:55.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.220 7f46addb3700 1 -- 172.21.15.73:0/2620322375 wait complete. 2024-03-24T10:39:55.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 Processor -- start 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 -- start start 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 0x7f71280f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 0x7f712810ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280f91a0 con 0x7f71280f1e30 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712810f050 con 0x7f71280f5890 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712fb06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71281ac5f0 con 0x7f71280f2280 2024-03-24T10:39:55.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f7127fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f71280f1e30 0x7f712810e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41004/0 (socket says 172.21.15.73:41004) 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f7127fff700 1 -- 172.21.15.73:0/487723171 learned_addr learned my addr 172.21.15.73:0/487723171 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712c901700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 0x7f71280f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.407 7f712d102700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 0x7f712810ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f71277fe700 1 -- 172.21.15.73:0/487723171 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755116533 0 0) 0x7f7114001110 con 0x7f71280f1e30 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f71277fe700 1 -- 172.21.15.73:0/487723171 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f710c003270 con 0x7f71280f1e30 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712c901700 1 -- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 msgr2=0x7f712810ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712c901700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 0x7f712810ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712c901700 1 -- 172.21.15.73:0/487723171 >> v1:172.21.15.73:6789/0 conn(0x7f71280f1e30 legacy=0x7f712810e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712c901700 1 -- 172.21.15.73:0/487723171 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71281ac7a0 con 0x7f71280f5890 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712d102700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 0x7f712810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712c901700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 0x7f71280f1800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7128103760 tx=0x7f711c00ba50).ready entity=mon.1 client_cookie=3e9c4e5115431b95 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f71277fe700 1 -- 172.21.15.73:0/487723171 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71281ac7a0 con 0x7f71280f5890 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f71277fe700 1 -- 172.21.15.73:0/487723171 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00d570 con 0x7f71280f5890 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f71277fe700 1 -- 172.21.15.73:0/487723171 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f711c00d940 con 0x7f71280f5890 2024-03-24T10:39:55.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712fb06700 1 -- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 msgr2=0x7f71280f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.408 7f712fb06700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 0x7f71280f1800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7128103760 tx=0x7f711c00ba50).stop 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 -- 172.21.15.73:0/487723171 shutdown_connections 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71280f2280 0x7f712810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 --2- 172.21.15.73:0/487723171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71280f5890 0x7f71280f1800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 -- 172.21.15.73:0/487723171 >> 172.21.15.73:0/487723171 conn(0x7f71281139e0 msgr2=0x7f71280f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 -- 172.21.15.73:0/487723171 shutdown_connections 2024-03-24T10:39:55.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.409 7f712fb06700 1 -- 172.21.15.73:0/487723171 wait complete. 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.431 7f712fb06700 1 Processor -- start 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.431 7f712fb06700 1 -- start start 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 0x7f71281b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 0x7f71280da9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280a26c0 con 0x7f71280d74c0 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280bc800 con 0x7f71281b52a0 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712fb06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71280d7910 con 0x7f71281b4e50 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f7127fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 0x7f71280da9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712c901700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 0x7f71281b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55112/0 (socket says 172.21.15.73:55112) 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f7127fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 0x7f71280da9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46356/0 (socket says 172.21.15.73:46356) 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 -- 172.21.15.73:0/4171635386 learned_addr learned my addr 172.21.15.73:0/4171635386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 -- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 msgr2=0x7f71280da9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 0x7f71280da9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 -- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 msgr2=0x7f71281b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 0x7f71281b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712d102700 1 -- 172.21.15.73:0/4171635386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280db630 con 0x7f71281b52a0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.432 7f712c901700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 0x7f71281b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f712d102700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f71280bd040 tx=0x7f712000ee30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71280db630 con 0x7f71281b52a0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000c850 con 0x7f71281b52a0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f712fb06700 1 -- 172.21.15.73:0/4171635386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71281bbd90 con 0x7f71281b52a0 2024-03-24T10:39:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f712000f040 con 0x7f71281b52a0 2024-03-24T10:39:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f712fb06700 1 -- 172.21.15.73:0/4171635386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71281bc170 con 0x7f71281b52a0 2024-03-24T10:39:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7120022060 con 0x7f71281b52a0 2024-03-24T10:39:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.433 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f7120010040 con 0x7f71281b52a0 2024-03-24T10:39:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.434 7f712fb06700 1 -- 172.21.15.73:0/4171635386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280d7040 con 0x7f71281b52a0 2024-03-24T10:39:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.437 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f712000c640 con 0x7f71281b52a0 2024-03-24T10:39:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:55.543 7f712fb06700 1 -- 172.21.15.73:0/4171635386 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f71280f0850 con 0x7f71281b52a0 2024-03-24T10:39:56.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.220 7f7125ffb700 1 -- 172.21.15.73:0/4171635386 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v19) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7128114560 con 0x7f71281b52a0 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 -- 172.21.15.73:0/4171635386 >> v1:172.21.15.73:6816/43277 conn(0x7f71100145b0 legacy=0x7f7110016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 -- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 msgr2=0x7f71280db000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f71280bd040 tx=0x7f712000ee30).stop 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 -- 172.21.15.73:0/4171635386 shutdown_connections 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71281b52a0 0x7f71280db000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71280d74c0 0x7f71281b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 --2- 172.21.15.73:0/4171635386 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f71281b4e50 0x7f71280da9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.227 7f712fb06700 1 -- 172.21.15.73:0/4171635386 >> 172.21.15.73:0/4171635386 conn(0x7f71280dc8f0 msgr2=0x7f71280cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.228 7f712fb06700 1 -- 172.21.15.73:0/4171635386 shutdown_connections 2024-03-24T10:39:56.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.232 7f712fb06700 1 -- 172.21.15.73:0/4171635386 wait complete. 2024-03-24T10:39:56.242 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-03-24T10:39:56.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 Processor -- start 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 -- start start 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 0x7f0c5410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 0x7f0c5419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c541a0a60 con 0x7f0c5410bb80 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540fa580 con 0x7f0c5410b730 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c58bcc700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c541a0c80 con 0x7f0c540f5a00 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c5104f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 0x7f0c5419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c51850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 0x7f0c5410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c52051700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0c5410bb80 0x7f0c541a0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41018/0 (socket says 172.21.15.73:41018) 2024-03-24T10:39:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.390 7f0c52051700 1 -- 172.21.15.73:0/1811851695 learned_addr learned my addr 172.21.15.73:0/1811851695 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c51850700 1 -- 172.21.15.73:0/1811851695 >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 msgr2=0x7f0c5419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c51850700 1 --2- 172.21.15.73:0/1811851695 >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 0x7f0c5419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c51850700 1 -- 172.21.15.73:0/1811851695 >> v1:172.21.15.73:6789/0 conn(0x7f0c5410bb80 legacy=0x7f0c541a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c5084e700 1 -- 172.21.15.73:0/1811851695 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450744013 0 0) 0x7f0c4c001490 con 0x7f0c5410bb80 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c51850700 1 -- 172.21.15.73:0/1811851695 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c541a93c0 con 0x7f0c540f5a00 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c5104f700 1 --2- 172.21.15.73:0/1811851695 >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 0x7f0c5419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c51850700 1 --2- 172.21.15.73:0/1811851695 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 0x7f0c5410b100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c4800b970).ready entity=mon.2 client_cookie=3d168ad43190e93 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c5084e700 1 -- 172.21.15.73:0/1811851695 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0c541a93c0 con 0x7f0c540f5a00 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c5084e700 1 -- 172.21.15.73:0/1811851695 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800d5c0 con 0x7f0c540f5a00 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c5084e700 1 -- 172.21.15.73:0/1811851695 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0c4800d990 con 0x7f0c540f5a00 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c58bcc700 1 -- 172.21.15.73:0/1811851695 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 msgr2=0x7f0c5410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.391 7f0c58bcc700 1 --2- 172.21.15.73:0/1811851695 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 0x7f0c5410b100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c4800b970).stop 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 -- 172.21.15.73:0/1811851695 shutdown_connections 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 --2- 172.21.15.73:0/1811851695 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540f5a00 0x7f0c5410b100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 --2- 172.21.15.73:0/1811851695 >> v2:172.21.15.73:3300/0 conn(0x7f0c5410b730 0x7f0c5419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 -- 172.21.15.73:0/1811851695 >> 172.21.15.73:0/1811851695 conn(0x7f0c54113a60 msgr2=0x7f0c540f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:56.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 -- 172.21.15.73:0/1811851695 shutdown_connections 2024-03-24T10:39:56.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.392 7f0c58bcc700 1 -- 172.21.15.73:0/1811851695 wait complete. 2024-03-24T10:39:56.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.414 7f0c58bcc700 1 Processor -- start 2024-03-24T10:39:56.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.414 7f0c58bcc700 1 -- start start 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 0x7f0c540c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540c5970 con 0x7f0c540dc830 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540dc4a0 con 0x7f0c540d7d70 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540dcc80 con 0x7f0c540d7920 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c51850700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46378/0 (socket says 172.21.15.73:46378) 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c51850700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44190/0 (socket says 172.21.15.73:44190) 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 -- 172.21.15.73:0/4229778656 learned_addr learned my addr 172.21.15.73:0/4229778656 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c52051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 0x7f0c540c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 -- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 msgr2=0x7f0c540c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 0x7f0c540c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 -- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 msgr2=0x7f0c540d72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 -- 172.21.15.73:0/4229778656 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540c7cf0 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c51850700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c52051700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 0x7f0c540c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c5104f700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0c540d8850 tx=0x7f0c4400bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0c540c7cf0 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400ee60 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.415 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c540c3190 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.416 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0c4400f040 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.416 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c540c3710 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.416 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0c44011070 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.416 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2799+0+0 (secure 0 0 0) 0x7f0c44010040 con 0x7f0c540d7920 2024-03-24T10:39:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.417 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c540f08d0 con 0x7f0c540d7920 2024-03-24T10:39:56.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.420 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0c4400c620 con 0x7f0c540d7920 2024-03-24T10:39:56.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:56.524 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c540a8580 con 0x7f0c540d7920 2024-03-24T10:39:57.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.235 7f0c42ffd700 1 -- 172.21.15.73:0/4229778656 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c44000c30 con 0x7f0c540d7920 2024-03-24T10:39:57.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.238 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 >> v1:172.21.15.73:6816/43277 conn(0x7f0c300145b0 legacy=0x7f0c30016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.238 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 msgr2=0x7f0c540c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.238 7f0c58bcc700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0c540d8850 tx=0x7f0c4400bf70).stop 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 shutdown_connections 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c540d7d70 0x7f0c540c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c540dc830 0x7f0c540d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 --2- 172.21.15.73:0/4229778656 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0c540d7920 0x7f0c540c7090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 >> 172.21.15.73:0/4229778656 conn(0x7f0c540c5450 msgr2=0x7f0c540c9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 shutdown_connections 2024-03-24T10:39:57.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.240 7f0c58bcc700 1 -- 172.21.15.73:0/4229778656 wait complete. 2024-03-24T10:39:57.242 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-03-24T10:39:57.256 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-24T10:39:57.256 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-24T10:39:57.256 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-24T10:39:57.256 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:39:57.265 INFO:tasks.ceph.mds.a:Stopped 2024-03-24T10:39:57.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-24T10:39:57.308 INFO:tasks.ceph.mds.a:Started 2024-03-24T10:39:57.309 DEBUG:teuthology.parallel:result is None 2024-03-24T10:39:57.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-24T10:39:57.380 INFO:tasks.ceph.mds.a.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:39:57.429 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-24T10:39:57.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 Processor -- start 2024-03-24T10:39:57.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 -- start start 2024-03-24T10:39:57.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34f010b900 0x7f34f01a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 0x7f34f01a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f010bd50 con 0x7f34f00f5a00 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f00fa580 con 0x7f34f010b900 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f781b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01a0c40 con 0x7f34f01a59c0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34f4e17700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 0x7f34f01a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34effff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f34f00f5a00 0x7f34f010b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41036/0 (socket says 172.21.15.73:41036) 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34ef7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34f010b900 0x7f34f01a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.442 7f34effff700 1 -- 172.21.15.73:0/2493621061 learned_addr learned my addr 172.21.15.73:0/2493621061 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f4e17700 1 -- 172.21.15.73:0/2493621061 >> v2:172.21.15.73:3300/0 conn(0x7f34f010b900 msgr2=0x7f34f01a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f4e17700 1 --2- 172.21.15.73:0/2493621061 >> v2:172.21.15.73:3300/0 conn(0x7f34f010b900 0x7f34f01a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f4e17700 1 -- 172.21.15.73:0/2493621061 >> v1:172.21.15.73:6789/0 conn(0x7f34f00f5a00 legacy=0x7f34f010b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34eeffd700 1 -- 172.21.15.73:0/2493621061 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740402188 0 0) 0x7f34e0001110 con 0x7f34f00f5a00 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f4e17700 1 -- 172.21.15.73:0/2493621061 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f01a9460 con 0x7f34f01a59c0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f4e17700 1 --2- 172.21.15.73:0/2493621061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 0x7f34f01a7e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f34f00f47b0 tx=0x7f34e8009cc0).ready entity=mon.1 client_cookie=eacabfd91ecb42b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34eeffd700 1 -- 172.21.15.73:0/2493621061 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34f01a9460 con 0x7f34f01a59c0 2024-03-24T10:39:57.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34eeffd700 1 -- 172.21.15.73:0/2493621061 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e800b840 con 0x7f34f01a59c0 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34eeffd700 1 -- 172.21.15.73:0/2493621061 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34e800ba20 con 0x7f34f01a59c0 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f781b700 1 -- 172.21.15.73:0/2493621061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 msgr2=0x7f34f01a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.443 7f34f781b700 1 --2- 172.21.15.73:0/2493621061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 0x7f34f01a7e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f34f00f47b0 tx=0x7f34e8009cc0).stop 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 -- 172.21.15.73:0/2493621061 shutdown_connections 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 --2- 172.21.15.73:0/2493621061 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01a59c0 0x7f34f01a7e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 --2- 172.21.15.73:0/2493621061 >> v2:172.21.15.73:3300/0 conn(0x7f34f010b900 0x7f34f01a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 -- 172.21.15.73:0/2493621061 >> 172.21.15.73:0/2493621061 conn(0x7f34f0113a60 msgr2=0x7f34f00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 -- 172.21.15.73:0/2493621061 shutdown_connections 2024-03-24T10:39:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.444 7f34f781b700 1 -- 172.21.15.73:0/2493621061 wait complete. 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 Processor -- start 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 -- start start 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 0x7f34f01b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 0x7f34f01b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00c5b80 con 0x7f34f01ab740 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00cfa80 con 0x7f34f01ac1c0 2024-03-24T10:39:57.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f781b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00cf310 con 0x7f34f01b28f0 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34ef7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 0x7f34f01b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44224/0 (socket says 172.21.15.73:44224) 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34effff700 1 -- 172.21.15.73:0/3544960992 learned_addr learned my addr 172.21.15.73:0/3544960992 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.467 7f34f4e17700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 0x7f34f01b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 -- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 msgr2=0x7f34f01b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 0x7f34f01b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 -- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 msgr2=0x7f34f01b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 0x7f34f01b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 -- 172.21.15.73:0/3544960992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00cef80 con 0x7f34f01ab740 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ef7fe700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 0x7f34f01b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:57.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34f4e17700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 0x7f34f01b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34effff700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f34f00e1500 tx=0x7f34e0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34f00cef80 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e00072e0 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34f781b700 1 -- 172.21.15.73:0/3544960992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f01b99b0 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34e0005810 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34f781b700 1 -- 172.21.15.73:0/3544960992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f01b9bb0 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f34e0005a10 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.468 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f34e0014500 con 0x7f34f01ab740 2024-03-24T10:39:57.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.469 7f34f781b700 1 -- 172.21.15.73:0/3544960992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f00f08d0 con 0x7f34f01ab740 2024-03-24T10:39:57.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.472 7f34ed7fa700 1 -- 172.21.15.73:0/3544960992 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f34e00070d0 con 0x7f34f01ab740 2024-03-24T10:39:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 >> v1:172.21.15.73:6816/43277 conn(0x7f34d00145b0 legacy=0x7f34d0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 msgr2=0x7f34f01abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f34f00e1500 tx=0x7f34e0007f70).stop 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 shutdown_connections 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f34f01b28f0 0x7f34f01b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f01ab740 0x7f34f01abb90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 --2- 172.21.15.73:0/3544960992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34f01ac1c0 0x7f34f01b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 >> 172.21.15.73:0/3544960992 conn(0x7f34f00c5660 msgr2=0x7f34f00c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 shutdown_connections 2024-03-24T10:39:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.623 7f34f781b700 1 -- 172.21.15.73:0/3544960992 wait complete. 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd perf 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd df {plain|tree} {class|name} {} 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd blocked-by 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool stats {} 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool scrub [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool deep-scrub [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool repair [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-recovery [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-backfill [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool cancel-force-recovery [...] 2024-03-24T10:39:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:39:57.633 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:39:57.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-03-24T10:39:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 Processor -- start 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 -- start start 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 0x7fc3040f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 0x7fc30410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040f9230 con 0x7fc3040f1ec0 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30410f0e0 con 0x7fc3040f5920 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.759 7fc30bf3a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041ac680 con 0x7fc3040f2310 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc308d35700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 0x7fc3040f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc303fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc3040f1ec0 0x7fc30410e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41048/0 (socket says 172.21.15.73:41048) 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc303fff700 1 -- 172.21.15.73:0/1376485111 learned_addr learned my addr 172.21.15.73:0/1376485111 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 --2- 172.21.15.73:0/1376485111 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 0x7fc30410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc3037fe700 1 -- 172.21.15.73:0/1376485111 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142269948 0 0) 0x7fc2f0001110 con 0x7fc3040f1ec0 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc3037fe700 1 -- 172.21.15.73:0/1376485111 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e8003270 con 0x7fc3040f1ec0 2024-03-24T10:39:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 -- 172.21.15.73:0/1376485111 >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 msgr2=0x7fc3040f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 --2- 172.21.15.73:0/1376485111 >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 0x7fc3040f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 -- 172.21.15.73:0/1376485111 >> v1:172.21.15.73:6789/0 conn(0x7fc3040f1ec0 legacy=0x7fc30410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 -- 172.21.15.73:0/1376485111 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3041ac830 con 0x7fc3040f2310 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc308d35700 1 --2- 172.21.15.73:0/1376485111 >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 0x7fc3040f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc309536700 1 --2- 172.21.15.73:0/1376485111 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 0x7fc30410eab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc2fc0032f0 tx=0x7fc2fc009c90).ready entity=mon.2 client_cookie=88f922ab94c4201e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc3037fe700 1 -- 172.21.15.73:0/1376485111 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3041ac830 con 0x7fc3040f2310 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc3037fe700 1 -- 172.21.15.73:0/1376485111 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc00b880 con 0x7fc3040f2310 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc3037fe700 1 -- 172.21.15.73:0/1376485111 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2fc00ba60 con 0x7fc3040f2310 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc30bf3a700 1 -- 172.21.15.73:0/1376485111 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 msgr2=0x7fc30410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.760 7fc30bf3a700 1 --2- 172.21.15.73:0/1376485111 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 0x7fc30410eab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc2fc0032f0 tx=0x7fc2fc009c90).stop 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 -- 172.21.15.73:0/1376485111 shutdown_connections 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 --2- 172.21.15.73:0/1376485111 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040f2310 0x7fc30410eab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 --2- 172.21.15.73:0/1376485111 >> v2:172.21.15.73:3300/0 conn(0x7fc3040f5920 0x7fc3040f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 -- 172.21.15.73:0/1376485111 >> 172.21.15.73:0/1376485111 conn(0x7fc304113a70 msgr2=0x7fc3040f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 -- 172.21.15.73:0/1376485111 shutdown_connections 2024-03-24T10:39:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.761 7fc30bf3a700 1 -- 172.21.15.73:0/1376485111 wait complete. 2024-03-24T10:39:57.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 Processor -- start 2024-03-24T10:39:57.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 -- start start 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 0x7fc3040d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040d5090 con 0x7fc3040d3640 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040d3e00 con 0x7fc3040c5190 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc30bf3a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cf050 con 0x7fc3040d31f0 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc308d35700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 0x7fc3040d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc309536700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc303fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc309536700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44252/0 (socket says 172.21.15.73:44252) 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc308d35700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 0x7fc3040d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55130/0 (socket says 172.21.15.73:55130) 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc303fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46412/0 (socket says 172.21.15.73:46412) 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.784 7fc309536700 1 -- 172.21.15.73:0/2658086231 learned_addr learned my addr 172.21.15.73:0/2658086231 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 -- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 msgr2=0x7fc3040ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 -- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 msgr2=0x7fc3040d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 0x7fc3040d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 -- 172.21.15.73:0/2658086231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3041bb930 con 0x7fc3040d3640 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc303fff700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc309536700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc2fc006fc0 tx=0x7fc2fc006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3041bb930 con 0x7fc3040d3640 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc011a50 con 0x7fc3040d3640 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2fc017040 con 0x7fc3040d3640 2024-03-24T10:39:57.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041bbb30 con 0x7fc3040d3640 2024-03-24T10:39:57.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3041bbf10 con 0x7fc3040d3640 2024-03-24T10:39:57.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.785 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc2fc01c470 con 0x7fc3040d3640 2024-03-24T10:39:57.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.786 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fc2fc018030 con 0x7fc3040d3640 2024-03-24T10:39:57.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.786 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040f08e0 con 0x7fc3040d3640 2024-03-24T10:39:57.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.789 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc2fc011840 con 0x7fc3040d3640 2024-03-24T10:39:57.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.895 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3041ae8d0 con 0x7fc3040d3640 2024-03-24T10:39:57.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.896 7fc301ffb700 1 -- 172.21.15.73:0/2658086231 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+11814 (secure 0 0 0) 0x7fc2fc00b670 con 0x7fc3040d3640 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 20, 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "7ccdf8d1-529f-44dc-adcb-8e62b7bebc17", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-24 10:39:02.180139", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-24 10:39:57.225592", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-03-24 10:39:08.204295", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-03-24 10:39:08.204295", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-03-24T10:39:57.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 3, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 4, 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "nautilus", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-03-24T10:39:57.898 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "nautilus", 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-03-24 10:39:11.524237", 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-03-24T10:39:57.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "12", 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-03-24T10:39:57.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-03-24T10:39:57.901 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-03-24T10:39:57.902 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.903 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "37db992e-449a-4d2e-b515-f07fdcf73249", 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:57.904 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6808", 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:57.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6809", 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6811", 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6810", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6808/43871", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6809/43871", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6811/43871", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6810/43871", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2", 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:57.909 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6812", 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6813", 2024-03-24T10:39:57.910 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6815", 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:57.911 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6814", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6812/43872", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6813/43872", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6815/43872", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6814/43872", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:57.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6f4717bb-78f4-490f-bd87-5d635f4bf7bc", 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:57.913 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6804", 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6805", 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:57.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6807", 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6806", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6804/43870", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6805/43870", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6807/43870", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6806/43870", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 3, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "326791eb-c8da-481b-9c06-3cc467120ce3", 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:57.917 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6800", 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6801", 2024-03-24T10:39:57.918 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6803", 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:57.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6802", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6800/43869", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6801/43869", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6803/43869", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6802/43869", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:57.920 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:57.921 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 3, 2024-03-24T10:39:57.922 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklist": { 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "172.21.15.73:6817/319226592": "2024-03-25 10:39:53.889110" 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-03-24T10:39:57.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {} 2024-03-24T10:39:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 >> v1:172.21.15.73:6816/43277 conn(0x7fc2ec0145b0 legacy=0x7fc2ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 msgr2=0x7fc3040cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc2fc006fc0 tx=0x7fc2fc006c40).stop 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 shutdown_connections 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3040d3640 0x7fc3040cea20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3040c5190 0x7fc3040d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 --2- 172.21.15.73:0/2658086231 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3040d31f0 0x7fc3040ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 >> 172.21.15.73:0/2658086231 conn(0x7fc3040c5af0 msgr2=0x7fc3040bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:57.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.897 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 shutdown_connections 2024-03-24T10:39:57.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:57.898 7fc30bf3a700 1 -- 172.21.15.73:0/2658086231 wait complete. 2024-03-24T10:39:57.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-03-24T10:39:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 Processor -- start 2024-03-24T10:39:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 -- start start 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f526c0f5920 0x7f526c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 0x7f526c10eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526c0f9230 con 0x7f526c0f1ec0 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c10f0e0 con 0x7f526c0f5920 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f5272763700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f526c1ac680 con 0x7f526c0f2310 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f526b3b0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f526c0f5920 0x7f526c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f526bbb1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 0x7f526c10eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f526abaf700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f526c0f1ec0 0x7f526c10e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41064/0 (socket says 172.21.15.73:41064) 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.052 7f526abaf700 1 -- 172.21.15.73:0/1250145880 learned_addr learned my addr 172.21.15.73:0/1250145880 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526a3ae700 1 -- 172.21.15.73:0/1250145880 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104910032 0 0) 0x7f5254001110 con 0x7f526c0f1ec0 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526a3ae700 1 -- 172.21.15.73:0/1250145880 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c003270 con 0x7f526c0f1ec0 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526b3b0700 1 -- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 msgr2=0x7f526c10eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526b3b0700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 0x7f526c10eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526b3b0700 1 -- 172.21.15.73:0/1250145880 >> v1:172.21.15.73:6789/0 conn(0x7f526c0f1ec0 legacy=0x7f526c10e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526b3b0700 1 -- 172.21.15.73:0/1250145880 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c1ac830 con 0x7f526c0f5920 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526bbb1700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 0x7f526c10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526b3b0700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0f5920 0x7f526c0f1890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f526c1037f0 tx=0x7f525c00ba20).ready entity=mon.0 client_cookie=11cb68803b464a8d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526a3ae700 1 -- 172.21.15.73:0/1250145880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f526c1ac830 con 0x7f526c0f5920 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526a3ae700 1 -- 172.21.15.73:0/1250145880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00d5c0 con 0x7f526c0f5920 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f526a3ae700 1 -- 172.21.15.73:0/1250145880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f525c00d990 con 0x7f526c0f5920 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f5272763700 1 -- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0f5920 msgr2=0x7f526c0f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.053 7f5272763700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0f5920 0x7f526c0f1890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f526c1037f0 tx=0x7f525c00ba20).stop 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 -- 172.21.15.73:0/1250145880 shutdown_connections 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0f2310 0x7f526c10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 --2- 172.21.15.73:0/1250145880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0f5920 0x7f526c0f1890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 -- 172.21.15.73:0/1250145880 >> 172.21.15.73:0/1250145880 conn(0x7f526c113a70 msgr2=0x7f526c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 -- 172.21.15.73:0/1250145880 shutdown_connections 2024-03-24T10:39:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.054 7f5272763700 1 -- 172.21.15.73:0/1250145880 wait complete. 2024-03-24T10:39:58.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.076 7f5272763700 1 Processor -- start 2024-03-24T10:39:58.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 -- start start 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 0x7f526c1bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0bc8a0 con 0x7f526c0d7020 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0dbea0 con 0x7f526c1b4ce0 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f5272763700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0d6d90 con 0x7f526c0d7aa0 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526abaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526b3b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526abaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44276/0 (socket says 172.21.15.73:44276) 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526bbb1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 0x7f526c1bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526b3b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55140/0 (socket says 172.21.15.73:55140) 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.077 7f526abaf700 1 -- 172.21.15.73:0/399365451 learned_addr learned my addr 172.21.15.73:0/399365451 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 -- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 msgr2=0x7f526c1bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 0x7f526c1bbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 -- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 msgr2=0x7f526c1b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 -- 172.21.15.73:0/399365451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0d7ef0 con 0x7f526c0d7020 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526b3b0700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526bbb1700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 0x7f526c1bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f526abaf700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f526c0bf0b0 tx=0x7f525400c840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f526c0d7ef0 con 0x7f526c0d7020 2024-03-24T10:39:58.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52540072e0 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5272763700 1 -- 172.21.15.73:0/399365451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c1b5760 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5254005810 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5272763700 1 -- 172.21.15.73:0/399365451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c1bc240 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5254005a10 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.078 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f5254014500 con 0x7f526c0d7020 2024-03-24T10:39:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.079 7f5272763700 1 -- 172.21.15.73:0/399365451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c0f08e0 con 0x7f526c0d7020 2024-03-24T10:39:58.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.082 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f52540070d0 con 0x7f526c0d7020 2024-03-24T10:39:58.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.188 7f5272763700 1 -- 172.21.15.73:0/399365451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f526c0e2430 con 0x7f526c0d7020 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.189 7f5268bab700 1 -- 172.21.15.73:0/399365451 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+11814 (secure 0 0 0) 0x7f526c0f1520 con 0x7f526c0d7020 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 20, 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "7ccdf8d1-529f-44dc-adcb-8e62b7bebc17", 2024-03-24T10:39:58.189 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-24 10:39:02.180139", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-24 10:39:57.225592", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-03-24 10:39:08.204295", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-03-24 10:39:08.204295", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-03-24T10:39:58.190 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 3, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 4, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "nautilus", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "nautilus", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-03-24 10:39:11.524237", 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-03-24T10:39:58.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-03-24T10:39:58.192 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "12", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-03-24T10:39:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-03-24T10:39:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-03-24T10:39:58.195 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "37db992e-449a-4d2e-b515-f07fdcf73249", 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:58.196 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6808", 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6809", 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6811", 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6810", 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43871 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6808/43871", 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6809/43871", 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6811/43871", 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6810/43871", 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.200 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2", 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6812", 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6813", 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6815", 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6814", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43872 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6812/43872", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6813/43872", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6815/43872", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6814/43872", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6f4717bb-78f4-490f-bd87-5d635f4bf7bc", 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6804", 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6805", 2024-03-24T10:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6807", 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6806", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43870 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6804/43870", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6805/43870", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6807/43870", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6806/43870", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 3, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "326791eb-c8da-481b-9c06-3cc467120ce3", 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 14, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6800", 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6801", 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6803", 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6802", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 43869 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6800/43869", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.73:6801/43869", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.73:6803/43869", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.73:6802/43869", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-03-24T10:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 3, 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4611087854035861503, 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklist": { 2024-03-24T10:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "172.21.15.73:6817/319226592": "2024-03-25 10:39:53.889110" 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-03-24T10:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {} 2024-03-24T10:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 >> v1:172.21.15.73:6816/43277 conn(0x7f52500145b0 legacy=0x7f5250016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 msgr2=0x7f526c0d7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f526c0bf0b0 tx=0x7f525400c840).stop 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 shutdown_connections 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f526c0d7aa0 0x7f526c1bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f526c1b4ce0 0x7f526c1b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 --2- 172.21.15.73:0/399365451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f526c0d7020 0x7f526c0d7470 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 >> 172.21.15.73:0/399365451 conn(0x7f526c0dca10 msgr2=0x7f526c0be050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:58.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 shutdown_connections 2024-03-24T10:39:58.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.190 7f5272763700 1 -- 172.21.15.73:0/399365451 wait complete. 2024-03-24T10:39:58.219 INFO:tasks.cephfs.cephfs_test_case:Removing 1 blacklist entries 2024-03-24T10:39:58.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist rm 172.21.15.73:6817/319226592 2024-03-24T10:39:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 Processor -- start 2024-03-24T10:39:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 -- start start 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 0x7fb8140f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8140fa200 con 0x7fb81410cd30 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140f9530 con 0x7fb81410c8e0 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.347 7fb81a4fa700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140f2460 con 0x7fb8140f5890 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb812ac0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 0x7fb8140f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb813ac2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb812ac0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 0x7fb8140f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55154/0 (socket says 172.21.15.73:55154) 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46450/0 (socket says 172.21.15.73:46450) 2024-03-24T10:39:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb812ac0700 1 -- 172.21.15.73:0/1909008414 learned_addr learned my addr 172.21.15.73:0/1909008414 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb813ac2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44286/0 (socket says 172.21.15.73:44286) 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 -- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 msgr2=0x7fb8140f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 --2- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 0x7fb8140f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 -- 172.21.15.73:0/1909008414 >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 msgr2=0x7fb8140f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 --2- 172.21.15.73:0/1909008414 >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 -- 172.21.15.73:0/1909008414 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140f2690 con 0x7fb8140f5890 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb813ac2700 1 --2- 172.21.15.73:0/1909008414 >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8132c1700 1 --2- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb804002f70 tx=0x7fb80400b970).ready entity=mon.2 client_cookie=b99b9db048d66c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8122bf700 1 -- 172.21.15.73:0/1909008414 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8140f2690 con 0x7fb8140f5890 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8122bf700 1 -- 172.21.15.73:0/1909008414 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80400d570 con 0x7fb8140f5890 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb8122bf700 1 -- 172.21.15.73:0/1909008414 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb80400d940 con 0x7fb8140f5890 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb81a4fa700 1 -- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 msgr2=0x7fb81410c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.348 7fb81a4fa700 1 --2- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb804002f70 tx=0x7fb80400b970).stop 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 -- 172.21.15.73:0/1909008414 shutdown_connections 2024-03-24T10:39:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 --2- 172.21.15.73:0/1909008414 >> v2:172.21.15.73:3300/0 conn(0x7fb81410cd30 0x7fb8140f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 --2- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140f5890 0x7fb81410c2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 --2- 172.21.15.73:0/1909008414 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb81410c8e0 0x7fb8140f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 -- 172.21.15.73:0/1909008414 >> 172.21.15.73:0/1909008414 conn(0x7fb8141139e0 msgr2=0x7fb8140f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 -- 172.21.15.73:0/1909008414 shutdown_connections 2024-03-24T10:39:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.349 7fb81a4fa700 1 -- 172.21.15.73:0/1909008414 wait complete. 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 Processor -- start 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 -- start start 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 0x7fb8140d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 0x7fb8140da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:58.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140daed0 con 0x7fb8140dfef0 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140daa50 con 0x7fb8140d3d90 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb81a4fa700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140dac30 con 0x7fb8140d41e0 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb8132c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb812ac0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 0x7fb8140d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb813ac2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 0x7fb8140da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb8132c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44296/0 (socket says 172.21.15.73:44296) 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.372 7fb8132c1700 1 -- 172.21.15.73:0/2528546383 learned_addr learned my addr 172.21.15.73:0/2528546383 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 -- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 msgr2=0x7fb8140da420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 0x7fb8140da420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 -- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 msgr2=0x7fb8140d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:58.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 -- 172.21.15.73:0/2528546383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8141bbd20 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb8132c1700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb813ac2700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 0x7fb8140da420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb812ac0700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 0x7fb8140d9df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb80800c000 tx=0x7fb80800ea50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8141bbd20 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808012600 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8141bbf20 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb80800f040 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8141bc300 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb808022060 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.373 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fb808010040 con 0x7fb8140d3d90 2024-03-24T10:39:58.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.374 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140f0850 con 0x7fb8140d3d90 2024-03-24T10:39:58.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.377 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb8080123f0 con 0x7fb8140d3d90 2024-03-24T10:39:58.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:58.494 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.73:6817/319226592"} v 0) v1 -- 0x7fb8141aec40 con 0x7fb8140d3d90 2024-03-24T10:39:59.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.239 7fb810abc700 1 -- 172.21.15.73:0/2528546383 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.73:6817/319226592"}]=0 un-blacklisting 172.21.15.73:6817/319226592 v21) v1 ==== 164+0+0 (secure 0 0 0) 0x7fb808000c30 con 0x7fb8140d3d90 2024-03-24T10:39:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 >> v1:172.21.15.73:6816/43277 conn(0x7fb7f40145b0 legacy=0x7fb7f4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 msgr2=0x7fb8140d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 0x7fb8140d9df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb80800c000 tx=0x7fb80800ea50).stop 2024-03-24T10:39:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 shutdown_connections 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8140d41e0 0x7fb8140da420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8140dfef0 0x7fb8140d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 --2- 172.21.15.73:0/2528546383 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8140d3d90 0x7fb8140d9df0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 >> 172.21.15.73:0/2528546383 conn(0x7fb8140c38c0 msgr2=0x7fb8140c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 shutdown_connections 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.241 7fb81a4fa700 1 -- 172.21.15.73:0/2528546383 wait complete. 2024-03-24T10:39:59.242 INFO:teuthology.orchestra.run.smithi073.stderr:un-blacklisting 172.21.15.73:6817/319226592 2024-03-24T10:39:59.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 Processor -- start 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 -- start start 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 0x7fece81a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 0x7fece81ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece80f9230 con 0x7fece80f5920 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80f24e0 con 0x7fece80f2090 2024-03-24T10:39:59.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7feceda72700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece81ac720 con 0x7fece81a8c80 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7fece605c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 0x7fece81a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7fece685d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fece80f5920 0x7fece80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41078/0 (socket says 172.21.15.73:41078) 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece685d700 1 -- 172.21.15.73:0/2789455593 learned_addr learned my addr 172.21.15.73:0/2789455593 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.382 7fece705e700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 0x7fece81ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece605c700 1 -- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 msgr2=0x7fece81ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece585b700 1 -- 172.21.15.73:0/2789455593 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541126975 0 0) 0x7fecdc001110 con 0x7fece80f5920 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece605c700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 0x7fece81ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece605c700 1 -- 172.21.15.73:0/2789455593 >> v1:172.21.15.73:6789/0 conn(0x7fece80f5920 legacy=0x7fece80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece605c700 1 -- 172.21.15.73:0/2789455593 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece81ac8d0 con 0x7fece80f2090 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece705e700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 0x7fece81ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece605c700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 0x7fece81a8650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fece80f4640 tx=0x7fecd800ba50).ready entity=mon.1 client_cookie=708f380fd3182054 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece585b700 1 -- 172.21.15.73:0/2789455593 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fece81ac8d0 con 0x7fece80f2090 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece585b700 1 -- 172.21.15.73:0/2789455593 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800d570 con 0x7fece80f2090 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7fece585b700 1 -- 172.21.15.73:0/2789455593 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecd800d940 con 0x7fece80f2090 2024-03-24T10:39:59.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7feceda72700 1 -- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 msgr2=0x7fece81a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.383 7feceda72700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 0x7fece81a8650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fece80f4640 tx=0x7fecd800ba50).stop 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 -- 172.21.15.73:0/2789455593 shutdown_connections 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece81a8c80 0x7fece81ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 --2- 172.21.15.73:0/2789455593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece80f2090 0x7fece81a8650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 -- 172.21.15.73:0/2789455593 >> 172.21.15.73:0/2789455593 conn(0x7fece8113a70 msgr2=0x7fece80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 -- 172.21.15.73:0/2789455593 shutdown_connections 2024-03-24T10:39:59.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.384 7feceda72700 1 -- 172.21.15.73:0/2789455593 wait complete. 2024-03-24T10:39:59.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 Processor -- start 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 -- start start 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 0x7fece81b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80bc510 con 0x7fece80bef20 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80c3720 con 0x7fece81b4f80 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7feceda72700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece80c0220 con 0x7fece80bf9a0 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 0x7fece81b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece705e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece705e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55202/0 (socket says 172.21.15.73:55202) 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44302/0 (socket says 172.21.15.73:44302) 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece705e700 1 -- 172.21.15.73:0/1162753416 learned_addr learned my addr 172.21.15.73:0/1162753416 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:59.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece605c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 0x7fece81b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:46488/0 (socket says 172.21.15.73:46488) 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 -- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 msgr2=0x7fece81b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 0x7fece81b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 -- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 msgr2=0x7fece81bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.407 7fece685d700 1 -- 172.21.15.73:0/1162753416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80c0720 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fece705e700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fece685d700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fece80c04b0 tx=0x7fecdc00c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fece80c0720 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc0070d0 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7feceda72700 1 -- 172.21.15.73:0/1162753416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece81b53d0 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fecdc005620 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7feceda72700 1 -- 172.21.15.73:0/1162753416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81bc1d0 con 0x7fece80bef20 2024-03-24T10:39:59.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fecdc005820 con 0x7fece80bef20 2024-03-24T10:39:59.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.408 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fecdc004ef0 con 0x7fece80bef20 2024-03-24T10:39:59.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.409 7feceda72700 1 -- 172.21.15.73:0/1162753416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece80bfdf0 con 0x7fece80bef20 2024-03-24T10:39:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.412 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fecdc00cdd0 con 0x7fece80bef20 2024-03-24T10:39:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.550 7feceda72700 1 -- 172.21.15.73:0/1162753416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fece80f08e0 con 0x7fece80bef20 2024-03-24T10:39:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.550 7fecd7fff700 1 -- 172.21.15.73:0/1162753416 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+3573 (secure 0 0 0) 0x7fecdc000c30 con 0x7fece80bef20 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC0AgBmUJHKIhAAl4h/Uw6wCB7id6j7kmHh+w==", 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC4AgBm32KxBhAAvFLoF3BV6iQc1/xAr8upqQ==", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC7AgBmI3JPCBAAMl2jhH6F3pW9clY81dUJwg==", 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.552 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC+AgBmxjWzBhAAdJQ5U87w2UXDxTmVjrSulw==", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDBAgBmFyaEBxAABdOTtNiEEFOZm3twCUdQmA==", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC0AgBmd3PYNhAAgO9xCWK0IwIO/3SLOIT7yQ==", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-03-24T10:39:59.554 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC0AgBmZtDXAhAAUdF4eEaReXMo5nPY/zl01g==", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.555 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBmNczAChAA4npKXt7nHR6isKL7eZC3sQ==", 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBmS9bAChAAsPQtW3QRXF8B29KLTYZUOQ==", 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.556 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBm39/AChAA5A4UN8sF4ifudSiCrqiNCA==", 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBmtufAChAAoq5AgsLu7ZBjdjQ6Q11z6g==", 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-24T10:39:59.557 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBmcPDAChAAXznzPLy4pjzJPSYL5WAZQg==", 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDGAgBmj/jAChAAYzLwaH5WoS6kW5XYsC6T9g==", 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:39:59.558 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQC0AgBmXOJXHhAA7xfiRrK1z7FOyphG0TQY8A==", 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-24T10:39:59.559 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 >> v1:172.21.15.73:6816/43277 conn(0x7fecc40145b0 legacy=0x7fecc4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 msgr2=0x7fece80bf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fece80c04b0 tx=0x7fecdc00c860).stop 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 shutdown_connections 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fece81b4f80 0x7fece81bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fece80bef20 0x7fece80bf370 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 --2- 172.21.15.73:0/1162753416 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fece80bf9a0 0x7fece81b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 >> 172.21.15.73:0/1162753416 conn(0x7fece80bd430 msgr2=0x7fece80c1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 shutdown_connections 2024-03-24T10:39:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.551 7feceda72700 1 -- 172.21.15.73:0/1162753416 wait complete. 2024-03-24T10:39:59.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 Processor -- start 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 -- start start 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4041a59c0 0x7fe4041a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40410bd50 con 0x7fe4040f5a00 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040fa580 con 0x7fe4041a59c0 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40ba6f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041a0c40 con 0x7fe40410b900 2024-03-24T10:39:59.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40906b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4041a59c0 0x7fe4041a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55210/0 (socket says 172.21.15.73:55210) 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 -- 172.21.15.73:0/1277741879 learned_addr learned my addr 172.21.15.73:0/1277741879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe40886a700 1 --1- 172.21.15.73:0/1277741879 >> v1:172.21.15.73:6789/0 conn(0x7fe4040f5a00 0x7fe40410b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41084/0 (socket says 172.21.15.73:41084) 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 -- 172.21.15.73:0/1277741879 >> v2:172.21.15.73:3300/0 conn(0x7fe4041a59c0 msgr2=0x7fe4041a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe4037fe700 1 -- 172.21.15.73:0/1277741879 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724573085 0 0) 0x7fe3f8001110 con 0x7fe4040f5a00 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 --2- 172.21.15.73:0/1277741879 >> v2:172.21.15.73:3300/0 conn(0x7fe4041a59c0 0x7fe4041a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 -- 172.21.15.73:0/1277741879 >> v1:172.21.15.73:6789/0 conn(0x7fe4040f5a00 legacy=0x7fe40410b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.689 7fe403fff700 1 -- 172.21.15.73:0/1277741879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4041a9460 con 0x7fe40410b900 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe403fff700 1 --2- 172.21.15.73:0/1277741879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe404103a00 tx=0x7fe3f000cab0).ready entity=mon.1 client_cookie=2c91387531dee1d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe4037fe700 1 -- 172.21.15.73:0/1277741879 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4041a9460 con 0x7fe40410b900 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe4037fe700 1 -- 172.21.15.73:0/1277741879 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000ba30 con 0x7fe40410b900 2024-03-24T10:39:59.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe4037fe700 1 -- 172.21.15.73:0/1277741879 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3f000be00 con 0x7fe40410b900 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 -- 172.21.15.73:0/1277741879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 msgr2=0x7fe4041a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 --2- 172.21.15.73:0/1277741879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe404103a00 tx=0x7fe3f000cab0).stop 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 -- 172.21.15.73:0/1277741879 shutdown_connections 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 --2- 172.21.15.73:0/1277741879 >> v2:172.21.15.73:3300/0 conn(0x7fe4041a59c0 0x7fe4041a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 --2- 172.21.15.73:0/1277741879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe40410b900 0x7fe4041a5390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 -- 172.21.15.73:0/1277741879 >> 172.21.15.73:0/1277741879 conn(0x7fe404113a60 msgr2=0x7fe4040f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 -- 172.21.15.73:0/1277741879 shutdown_connections 2024-03-24T10:39:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.690 7fe40ba6f700 1 -- 172.21.15.73:0/1277741879 wait complete. 2024-03-24T10:39:59.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.713 7fe40ba6f700 1 Processor -- start 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.713 7fe40ba6f700 1 -- start start 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4040ca410 0x7fe4041a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 0x7fe4040d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040c52f0 con 0x7fe4041a9d30 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040d50e0 con 0x7fe4040ca410 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040d5310 con 0x7fe4041aa180 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe403fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe403fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44316/0 (socket says 172.21.15.73:44316) 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe403fff700 1 -- 172.21.15.73:0/3977619929 learned_addr learned my addr 172.21.15.73:0/3977619929 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 0x7fe4040d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40886a700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4040ca410 0x7fe4041a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:39:59.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 -- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4040ca410 msgr2=0x7fe4041a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4040ca410 0x7fe4041a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 -- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 msgr2=0x7fe4040d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 -- 172.21.15.73:0/3977619929 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4041b77d0 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe403fff700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40906b700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 0x7fe4040d4ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe3fc010000 tx=0x7fe3fc0103a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4041b77d0 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc014040 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4041b79d0 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3fc010d90 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.714 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4041b7db0 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.715 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe3fc00b450 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.715 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fe3fc002c40 con 0x7fe4041aa180 2024-03-24T10:39:59.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.715 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4040f08d0 con 0x7fe4041aa180 2024-03-24T10:39:59.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.719 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe3fc00d0d0 con 0x7fe4041aa180 2024-03-24T10:39:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.855 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe4040ab8d0 con 0x7fe4041aa180 2024-03-24T10:39:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.858 7fe401ffb700 1 -- 172.21.15.73:0/3977619929 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe4041145e0 con 0x7fe4041aa180 2024-03-24T10:39:59.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 >> v1:172.21.15.73:6816/43277 conn(0x7fe3ec0145b0 legacy=0x7fe3ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 msgr2=0x7fe4040d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:39:59.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 0x7fe4040d4ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe3fc010000 tx=0x7fe3fc0103a0).stop 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 shutdown_connections 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe4041aa180 0x7fe4040d4ab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4040ca410 0x7fe4041a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 --2- 172.21.15.73:0/3977619929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4041a9d30 0x7fe4040d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 >> 172.21.15.73:0/3977619929 conn(0x7fe4040c7f00 msgr2=0x7fe4040c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 shutdown_connections 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.860 7fe40ba6f700 1 -- 172.21.15.73:0/3977619929 wait complete. 2024-03-24T10:39:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:39:59.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 Processor -- start 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 -- start start 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 0x7fd4181a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 0x7fd4181a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41810bcd0 con 0x7fd4180f5980 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180fa500 con 0x7fd41810b880 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41f58f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4181a0bc0 con 0x7fd4181a5940 2024-03-24T10:40:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd417fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd4180f5980 0x7fd41810b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41092/0 (socket says 172.21.15.73:41092) 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd417fff700 1 -- 172.21.15.73:0/1411232086 learned_addr learned my addr 172.21.15.73:0/1411232086 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41cb8b700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 0x7fd4181a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd4177fe700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 0x7fd4181a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41cb8b700 1 -- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 msgr2=0x7fd4181a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd41cb8b700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 0x7fd4181a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:39:59.999 7fd416ffd700 1 -- 172.21.15.73:0/1411232086 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009824494 0 0) 0x7fd408001110 con 0x7fd4180f5980 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41cb8b700 1 -- 172.21.15.73:0/1411232086 >> v1:172.21.15.73:6789/0 conn(0x7fd4180f5980 legacy=0x7fd41810b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41cb8b700 1 -- 172.21.15.73:0/1411232086 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4181a93e0 con 0x7fd4181a5940 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd4177fe700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 0x7fd4181a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41cb8b700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 0x7fd4181a7da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd4180f4730 tx=0x7fd410009cf0).ready entity=mon.2 client_cookie=d3728b863c8591c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd416ffd700 1 -- 172.21.15.73:0/1411232086 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4181a93e0 con 0x7fd4181a5940 2024-03-24T10:40:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd416ffd700 1 -- 172.21.15.73:0/1411232086 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41000ba30 con 0x7fd4181a5940 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd416ffd700 1 -- 172.21.15.73:0/1411232086 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd41000be00 con 0x7fd4181a5940 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 -- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 msgr2=0x7fd4181a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 0x7fd4181a7da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd4180f4730 tx=0x7fd410009cf0).stop 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 -- 172.21.15.73:0/1411232086 shutdown_connections 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4181a5940 0x7fd4181a7da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 --2- 172.21.15.73:0/1411232086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41810b880 0x7fd4181a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 -- 172.21.15.73:0/1411232086 >> 172.21.15.73:0/1411232086 conn(0x7fd4181139e0 msgr2=0x7fd4180f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 -- 172.21.15.73:0/1411232086 shutdown_connections 2024-03-24T10:40:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.000 7fd41f58f700 1 -- 172.21.15.73:0/1411232086 wait complete. 2024-03-24T10:40:00.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 Processor -- start 2024-03-24T10:40:00.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 -- start start 2024-03-24T10:40:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 0x7fd4181b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180c7e00 con 0x7fd4180c77d0 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180c7fe0 con 0x7fd4180d5770 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd41f58f700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4181b0ad0 con 0x7fd4180d5bc0 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd417fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd4177fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd4177fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:55252/0 (socket says 172.21.15.73:55252) 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd4177fe700 1 -- 172.21.15.73:0/501546839 learned_addr learned my addr 172.21.15.73:0/501546839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.023 7fd417fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44324/0 (socket says 172.21.15.73:44324) 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 0x7fd4181b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 -- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 msgr2=0x7fd4181afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 -- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 msgr2=0x7fd4180d5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 -- 172.21.15.73:0/501546839 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4181b0d00 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd4177fe700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd417fff700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41cb8b700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 0x7fd4181b04a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd4180c40c0 tx=0x7fd410006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4181b0d00 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410010d90 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41f58f700 1 -- 172.21.15.73:0/501546839 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4181b7560 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4100185f0 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.024 7fd41f58f700 1 -- 172.21.15.73:0/501546839 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4181b7940 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.025 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd4100187f0 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.025 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fd41001ed00 con 0x7fd4180d5bc0 2024-03-24T10:40:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.025 7fd41f58f700 1 -- 172.21.15.73:0/501546839 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4180f0850 con 0x7fd4180d5bc0 2024-03-24T10:40:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.028 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd41000b630 con 0x7fd4180d5bc0 2024-03-24T10:40:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.166 7fd41f58f700 1 -- 172.21.15.73:0/501546839 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd4181aa5b0 con 0x7fd4180d5bc0 2024-03-24T10:40:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.172 7fd4157fa700 1 -- 172.21.15.73:0/501546839 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd410010990 con 0x7fd4180d5bc0 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 >> v1:172.21.15.73:6816/43277 conn(0x7fd3f80145b0 legacy=0x7fd3f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 msgr2=0x7fd4181b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 0x7fd4181b04a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd4180c40c0 tx=0x7fd410006c40).stop 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 shutdown_connections 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4180d5bc0 0x7fd4181b04a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c77d0 0x7fd4180d5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 --2- 172.21.15.73:0/501546839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4180d5770 0x7fd4181afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 >> 172.21.15.73:0/501546839 conn(0x7fd4180c4680 msgr2=0x7fd4180c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 shutdown_connections 2024-03-24T10:40:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.173 7fd41f58f700 1 -- 172.21.15.73:0/501546839 wait complete. 2024-03-24T10:40:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:40:00.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 Processor -- start 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 -- start start 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 0x7f15e40f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 0x7f15e410e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40f9220 con 0x7f15e40f2300 2024-03-24T10:40:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e410f0d0 con 0x7f15e40f5910 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e8d93700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41ac670 con 0x7f15e40f1eb0 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e1b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 0x7f15e40f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e1363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 0x7f15e410e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e2365700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15e40f2300 0x7f15e410e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60104/0 (socket says 172.21.15.73:60104) 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.314 7f15e2365700 1 -- 172.21.15.73:0/3613285494 learned_addr learned my addr 172.21.15.73:0/3613285494 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e0b62700 1 -- 172.21.15.73:0/3613285494 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398263036 0 0) 0x7f15dc001490 con 0x7f15e40f2300 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1b64700 1 -- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 msgr2=0x7f15e410e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1b64700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 0x7f15e410e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1b64700 1 -- 172.21.15.73:0/3613285494 >> v1:172.21.15.73:6789/0 conn(0x7f15e40f2300 legacy=0x7f15e410e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1b64700 1 -- 172.21.15.73:0/3613285494 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e41ac820 con 0x7f15e40f5910 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1363700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 0x7f15e410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e1b64700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 0x7f15e40f1880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f15d8002f70 tx=0x7f15d800ba20).ready entity=mon.1 client_cookie=3f21a67877ea8c63 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e0b62700 1 -- 172.21.15.73:0/3613285494 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15e41ac820 con 0x7f15e40f5910 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e0b62700 1 -- 172.21.15.73:0/3613285494 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800d570 con 0x7f15e40f5910 2024-03-24T10:40:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e0b62700 1 -- 172.21.15.73:0/3613285494 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15d800d990 con 0x7f15e40f5910 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 -- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 msgr2=0x7f15e40f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 0x7f15e40f1880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f15d8002f70 tx=0x7f15d800ba20).stop 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 -- 172.21.15.73:0/3613285494 shutdown_connections 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40f5910 0x7f15e40f1880 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 --2- 172.21.15.73:0/3613285494 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40f1eb0 0x7f15e410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.315 7f15e8d93700 1 -- 172.21.15.73:0/3613285494 >> 172.21.15.73:0/3613285494 conn(0x7f15e4113a60 msgr2=0x7f15e40f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.316 7f15e8d93700 1 -- 172.21.15.73:0/3613285494 shutdown_connections 2024-03-24T10:40:00.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.316 7f15e8d93700 1 -- 172.21.15.73:0/3613285494 wait complete. 2024-03-24T10:40:00.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.338 7f15e8d93700 1 Processor -- start 2024-03-24T10:40:00.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.338 7f15e8d93700 1 -- start start 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 0x7f15e41b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 0x7f15e41b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40e6530 con 0x7f15e40cea20 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40bc260 con 0x7f15e40bb980 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e8d93700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41b4d80 con 0x7f15e40cee70 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e2365700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 0x7f15e41b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39888/0 (socket says 172.21.15.73:39888) 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 -- 172.21.15.73:0/1630810972 learned_addr learned my addr 172.21.15.73:0/1630810972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1363700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 0x7f15e41b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 -- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 msgr2=0x7f15e41b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 0x7f15e41b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 -- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 msgr2=0x7f15e41b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 0x7f15e41b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1b64700 1 -- 172.21.15.73:0/1630810972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e41b4fb0 con 0x7f15e40bb980 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e2365700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 0x7f15e41b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.339 7f15e1363700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 0x7f15e41b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15e1b64700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f15e40c2010 tx=0x7f15d80068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15e41b4fb0 con 0x7f15e40bb980 2024-03-24T10:40:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80119e0 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15d8017040 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e41bb8a0 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e41bbc80 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f15d8026360 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.340 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f15d8018070 con 0x7f15e40bb980 2024-03-24T10:40:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.341 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40f08d0 con 0x7f15e40bb980 2024-03-24T10:40:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.344 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f15d80117d0 con 0x7f15e40bb980 2024-03-24T10:40:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.481 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f15e41ae840 con 0x7f15e40bb980 2024-03-24T10:40:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.485 7f15d2ffd700 1 -- 172.21.15.73:0/1630810972 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f15d800d360 con 0x7f15e40bb980 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 >> v1:172.21.15.73:6816/43277 conn(0x7f15c00145b0 legacy=0x7f15c0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 msgr2=0x7f15e40ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f15e40c2010 tx=0x7f15d80068c0).stop 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 shutdown_connections 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f15e40cee70 0x7f15e41b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15e40bb980 0x7f15e40ce3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 --2- 172.21.15.73:0/1630810972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15e40cea20 0x7f15e41b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 >> 172.21.15.73:0/1630810972 conn(0x7f15e40c5a60 msgr2=0x7f15e40c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 shutdown_connections 2024-03-24T10:40:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.486 7f15e8d93700 1 -- 172.21.15.73:0/1630810972 wait complete. 2024-03-24T10:40:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:40:00.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-24T10:40:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.623 7f47dbc5d700 1 Processor -- start 2024-03-24T10:40:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.623 7f47dbc5d700 1 -- start start 2024-03-24T10:40:00.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47dbc5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 0x7f47d41a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47dbc5d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 0x7f47d41a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47dbc5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d410cf80 con 0x7f47d40f5910 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47dbc5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40fa280 con 0x7f47d410cb30 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47dbc5d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40f95b0 con 0x7f47d41a6bd0 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d8a58700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47d40f5910 0x7f47d410c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60118/0 (socket says 172.21.15.73:60118) 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d8a58700 1 -- 172.21.15.73:0/2072528809 learned_addr learned my addr 172.21.15.73:0/2072528809 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d3fff700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 0x7f47d41a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d9259700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 0x7f47d41a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d37fe700 1 -- 172.21.15.73:0/2072528809 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681458665 0 0) 0x7f47c8001110 con 0x7f47d40f5910 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d37fe700 1 -- 172.21.15.73:0/2072528809 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b8003270 con 0x7f47d40f5910 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d3fff700 1 -- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 msgr2=0x7f47d41a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d3fff700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 0x7f47d41a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d3fff700 1 -- 172.21.15.73:0/2072528809 >> v1:172.21.15.73:6789/0 conn(0x7f47d40f5910 legacy=0x7f47d410c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d3fff700 1 -- 172.21.15.73:0/2072528809 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d41aa670 con 0x7f47d410cb30 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.624 7f47d9259700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 0x7f47d41a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47d3fff700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 0x7f47d41a65a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f47d41133f0 tx=0x7f47c000ba50).ready entity=mon.1 client_cookie=bfcd65ba8c70eafd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47d37fe700 1 -- 172.21.15.73:0/2072528809 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47d41aa670 con 0x7f47d410cb30 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47d37fe700 1 -- 172.21.15.73:0/2072528809 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c000d570 con 0x7f47d410cb30 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47d37fe700 1 -- 172.21.15.73:0/2072528809 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47c000d940 con 0x7f47d410cb30 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 -- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 msgr2=0x7f47d41a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 0x7f47d41a65a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f47d41133f0 tx=0x7f47c000ba50).stop 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 -- 172.21.15.73:0/2072528809 shutdown_connections 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d41a6bd0 0x7f47d41a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 --2- 172.21.15.73:0/2072528809 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d410cb30 0x7f47d41a65a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 -- 172.21.15.73:0/2072528809 >> 172.21.15.73:0/2072528809 conn(0x7f47d4113a60 msgr2=0x7f47d40f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 -- 172.21.15.73:0/2072528809 shutdown_connections 2024-03-24T10:40:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.625 7f47dbc5d700 1 -- 172.21.15.73:0/2072528809 wait complete. 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.648 7f47dbc5d700 1 Processor -- start 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.648 7f47dbc5d700 1 -- start start 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40e6530 con 0x7f47d40d6780 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40cdaa0 con 0x7f47d40d6bd0 2024-03-24T10:40:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47dbc5d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40cd680 con 0x7f47d40ce3c0 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d8a58700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d9259700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d8a58700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54582/0 (socket says 172.21.15.73:54582) 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d8a58700 1 -- 172.21.15.73:0/4089794500 learned_addr learned my addr 172.21.15.73:0/4089794500 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38772/0 (socket says 172.21.15.73:38772) 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.649 7f47d9259700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39906/0 (socket says 172.21.15.73:39906) 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 -- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 msgr2=0x7f47d41b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 -- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 msgr2=0x7f47d41b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 -- 172.21.15.73:0/4089794500 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40cdd60 con 0x7f47d40ce3c0 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d9259700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d3fff700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d8a58700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f47d40cd9d0 tx=0x7f47c800c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47d40cdd60 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80072e0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d41b2cc0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47c8005810 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d40f6380 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f47c8005a10 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.650 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f47c8014620 con 0x7f47d40ce3c0 2024-03-24T10:40:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.651 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d40f08d0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.654 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f47c80070d0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.791 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f47d40effa0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.796 7f47d1ffb700 1 -- 172.21.15.73:0/4089794500 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f47d40fefb0 con 0x7f47d40ce3c0 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 >> v1:172.21.15.73:6816/43277 conn(0x7f47bc0145b0 legacy=0x7f47bc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 msgr2=0x7f47d40d6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f47d40cd9d0 tx=0x7f47c800c7c0).stop 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 shutdown_connections 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47d40d6bd0 0x7f47d41b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47d40ce3c0 0x7f47d40d6150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 --2- 172.21.15.73:0/4089794500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d40d6780 0x7f47d41b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 >> 172.21.15.73:0/4089794500 conn(0x7f47d40c39c0 msgr2=0x7f47d40dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 shutdown_connections 2024-03-24T10:40:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.797 7f47dbc5d700 1 -- 172.21.15.73:0/4089794500 wait complete. 2024-03-24T10:40:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:40:00.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.935 7fd19d1d1700 1 Processor -- start 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.935 7fd19d1d1700 1 -- start start 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd19d1d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 0x7fd1980f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd19d1d1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 0x7fd19810e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd19d1d1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1980f91a0 con 0x7fd1980f2280 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd19d1d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19810f050 con 0x7fd1980f5890 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd19d1d1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981ac5f0 con 0x7fd1980f1e30 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1965fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1980f2280 0x7fd19810e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60132/0 (socket says 172.21.15.73:60132) 2024-03-24T10:40:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1965fd700 1 -- 172.21.15.73:0/2793212378 learned_addr learned my addr 172.21.15.73:0/2793212378 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd195dfc700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 0x7fd1980f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 0x7fd19810e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1955fb700 1 -- 172.21.15.73:0/2793212378 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288952313 0 0) 0x7fd190001490 con 0x7fd1980f2280 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1955fb700 1 -- 172.21.15.73:0/2793212378 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd178003270 con 0x7fd1980f2280 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 -- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 msgr2=0x7fd1980f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 0x7fd1980f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 -- 172.21.15.73:0/2793212378 >> v1:172.21.15.73:6789/0 conn(0x7fd1980f2280 legacy=0x7fd19810e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 -- 172.21.15.73:0/2793212378 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1981ac7a0 con 0x7fd1980f1e30 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd195dfc700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 0x7fd1980f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd18d5fb700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 0x7fd19810e220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd180002f70 tx=0x7fd18000b9a0).ready entity=mon.2 client_cookie=420260c44c358ef6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1955fb700 1 -- 172.21.15.73:0/2793212378 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1981ac7a0 con 0x7fd1980f1e30 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1955fb700 1 -- 172.21.15.73:0/2793212378 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18000d5c0 con 0x7fd1980f1e30 2024-03-24T10:40:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.936 7fd1955fb700 1 -- 172.21.15.73:0/2793212378 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd18000d990 con 0x7fd1980f1e30 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 -- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 msgr2=0x7fd19810e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 0x7fd19810e220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd180002f70 tx=0x7fd18000b9a0).stop 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 -- 172.21.15.73:0/2793212378 shutdown_connections 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1980f5890 0x7fd1980f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 --2- 172.21.15.73:0/2793212378 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980f1e30 0x7fd19810e220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 -- 172.21.15.73:0/2793212378 >> 172.21.15.73:0/2793212378 conn(0x7fd1981139e0 msgr2=0x7fd1980f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 -- 172.21.15.73:0/2793212378 shutdown_connections 2024-03-24T10:40:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.937 7fd19d1d1700 1 -- 172.21.15.73:0/2793212378 wait complete. 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 Processor -- start 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 -- start start 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1980dafd0 0x7fd1981b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1981b4e50 0x7fd1981bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980dbcb0 con 0x7fd1980dafd0 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980d6bc0 con 0x7fd1981b4e50 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd19d1d1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980d7460 con 0x7fd1980da550 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd195dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd1965fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1981b4e50 0x7fd1981bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd18d5fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1980dafd0 0x7fd1981b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd195dfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54600/0 (socket says 172.21.15.73:54600) 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.960 7fd195dfc700 1 -- 172.21.15.73:0/3294742528 learned_addr learned my addr 172.21.15.73:0/3294742528 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 -- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1981b4e50 msgr2=0x7fd1981bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1981b4e50 0x7fd1981bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 -- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1980dafd0 msgr2=0x7fd1981b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1980dafd0 0x7fd1981b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 -- 172.21.15.73:0/3294742528 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1981b52a0 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd195dfc700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd18800c000 tx=0x7fd18800bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1981b52a0 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18800c870 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1981b55c0 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd18800f040 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1981bc490 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd188011070 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.961 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fd188010040 con 0x7fd1980da550 2024-03-24T10:40:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.962 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1980f0850 con 0x7fd1980da550 2024-03-24T10:40:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:00.965 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd18800c470 con 0x7fd1980da550 2024-03-24T10:40:01.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.104 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd1980cee30 con 0x7fd1980da550 2024-03-24T10:40:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.109 7fd18f7fe700 1 -- 172.21.15.73:0/3294742528 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd188000c30 con 0x7fd1980da550 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 >> v1:172.21.15.73:6816/43277 conn(0x7fd17c0145b0 legacy=0x7fd17c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 msgr2=0x7fd1980da9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd18800c000 tx=0x7fd18800bf70).stop 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 shutdown_connections 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1981b4e50 0x7fd1981bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd1980da550 0x7fd1980da9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 --2- 172.21.15.73:0/3294742528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1980dafd0 0x7fd1981b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 >> 172.21.15.73:0/3294742528 conn(0x7fd1980bd740 msgr2=0x7fd1980d89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 shutdown_connections 2024-03-24T10:40:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.111 7fd19d1d1700 1 -- 172.21.15.73:0/3294742528 wait complete. 2024-03-24T10:40:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:40:01.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-24T10:40:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.250 7f0d4e52b700 1 Processor -- start 2024-03-24T10:40:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.250 7f0d4e52b700 1 -- start start 2024-03-24T10:40:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 0x7f0d481a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d481a59c0 0x7f0d481a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4810bd50 con 0x7f0d480f5a00 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480fa580 con 0x7f0d4810b900 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481a0c40 con 0x7f0d481a59c0 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d472c1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0d480f5a00 0x7f0d4810b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60148/0 (socket says 172.21.15.73:60148) 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 0x7f0d481a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d472c1700 1 -- 172.21.15.73:0/1185558149 learned_addr learned my addr 172.21.15.73:0/1185558149 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d47ac2700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d481a59c0 0x7f0d481a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d462bf700 1 -- 172.21.15.73:0/1185558149 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781851203 0 0) 0x7f0d38001110 con 0x7f0d480f5a00 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 -- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d481a59c0 msgr2=0x7f0d481a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d481a59c0 0x7f0d481a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 -- 172.21.15.73:0/1185558149 >> v1:172.21.15.73:6789/0 conn(0x7f0d480f5a00 legacy=0x7f0d4810b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 -- 172.21.15.73:0/1185558149 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d481a9460 con 0x7f0d4810b900 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d46ac0700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 0x7f0d481a5390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0d48103a00 tx=0x7f0d3000ba50).ready entity=mon.1 client_cookie=9c5d4b11f0645523 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d462bf700 1 -- 172.21.15.73:0/1185558149 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d481a9460 con 0x7f0d4810b900 2024-03-24T10:40:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d462bf700 1 -- 172.21.15.73:0/1185558149 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000d570 con 0x7f0d4810b900 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d462bf700 1 -- 172.21.15.73:0/1185558149 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d3000d940 con 0x7f0d4810b900 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 -- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 msgr2=0x7f0d481a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.251 7f0d4e52b700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 0x7f0d481a5390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0d48103a00 tx=0x7f0d3000ba50).stop 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 -- 172.21.15.73:0/1185558149 shutdown_connections 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d481a59c0 0x7f0d481a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 --2- 172.21.15.73:0/1185558149 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d4810b900 0x7f0d481a5390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 -- 172.21.15.73:0/1185558149 >> 172.21.15.73:0/1185558149 conn(0x7f0d48113a60 msgr2=0x7f0d480f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 -- 172.21.15.73:0/1185558149 shutdown_connections 2024-03-24T10:40:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.252 7f0d4e52b700 1 -- 172.21.15.73:0/1185558149 wait complete. 2024-03-24T10:40:01.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.274 7f0d4e52b700 1 Processor -- start 2024-03-24T10:40:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 -- start start 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 0x7f0d480d3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 0x7f0d481bbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481a5160 con 0x7f0d480da8b0 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480c3970 con 0x7f0d480d2d10 2024-03-24T10:40:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d4e52b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480dd260 con 0x7f0d480d3790 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d472c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 0x7f0d480d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54622/0 (socket says 172.21.15.73:54622) 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 -- 172.21.15.73:0/3484206922 learned_addr learned my addr 172.21.15.73:0/3484206922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d47ac2700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 0x7f0d481bbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 -- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 msgr2=0x7f0d480d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 0x7f0d480d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 -- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 msgr2=0x7f0d481bbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 0x7f0d481bbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d46ac0700 1 -- 172.21.15.73:0/3484206922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480db360 con 0x7f0d480d3790 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d472c1700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 0x7f0d480d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.275 7f0d47ac2700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 0x7f0d481bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d46ac0700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0d480d6b20 tx=0x7f0d300068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d480db360 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30011a00 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d480dad00 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d30011dd0 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481bc1c0 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0d3001d450 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.276 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f0d30020ae0 con 0x7f0d480d3790 2024-03-24T10:40:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.277 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d480f08d0 con 0x7f0d480d3790 2024-03-24T10:40:01.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.280 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0d300117f0 con 0x7f0d480d3790 2024-03-24T10:40:01.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.420 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0d480ab8d0 con 0x7f0d480d3790 2024-03-24T10:40:01.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.427 7f0d44abc700 1 -- 172.21.15.73:0/3484206922 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0d3000d360 con 0x7f0d480d3790 2024-03-24T10:40:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 >> v1:172.21.15.73:6816/43277 conn(0x7f0d2c0145b0 legacy=0x7f0d2c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 msgr2=0x7f0d480da280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0d480d6b20 tx=0x7f0d300068c0).stop 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 shutdown_connections 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d480da8b0 0x7f0d481bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d480d2d10 0x7f0d480d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 --2- 172.21.15.73:0/3484206922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f0d480d3790 0x7f0d480da280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 >> 172.21.15.73:0/3484206922 conn(0x7f0d480c4b10 msgr2=0x7f0d481a10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 shutdown_connections 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.429 7f0d4e52b700 1 -- 172.21.15.73:0/3484206922 wait complete. 2024-03-24T10:40:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:updated 2024-03-24T10:40:01.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 Processor -- start 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 -- start start 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 0x7f310810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 0x7f31080f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31080f26c0 con 0x7f310810cdc0 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31080fa290 con 0x7f31080f5920 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f310d0c3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31080f95c0 con 0x7f310810c970 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f3105dfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 0x7f310810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f31065fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f310810cdc0 0x7f31080f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60162/0 (socket says 172.21.15.73:60162) 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f31055fb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 0x7f31080f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.566 7f31065fd700 1 -- 172.21.15.73:0/3238904924 learned_addr learned my addr 172.21.15.73:0/3238904924 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3105dfc700 1 -- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 msgr2=0x7f31080f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3105dfc700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 0x7f31080f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3104dfa700 1 -- 172.21.15.73:0/3238904924 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81584868 0 0) 0x7f30f8001110 con 0x7f310810cdc0 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3105dfc700 1 -- 172.21.15.73:0/3238904924 >> v1:172.21.15.73:6789/0 conn(0x7f310810cdc0 legacy=0x7f31080f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3105dfc700 1 -- 172.21.15.73:0/3238904924 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31081aa5e0 con 0x7f31080f5920 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f31055fb700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 0x7f31080f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3105dfc700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 0x7f310810c340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f31000032f0 tx=0x7f3100009d40).ready entity=mon.1 client_cookie=8ca390e95a71bbcd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3104dfa700 1 -- 172.21.15.73:0/3238904924 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31081aa5e0 con 0x7f31080f5920 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3104dfa700 1 -- 172.21.15.73:0/3238904924 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000b800 con 0x7f31080f5920 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f3104dfa700 1 -- 172.21.15.73:0/3238904924 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f310000b9e0 con 0x7f31080f5920 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f310d0c3700 1 -- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 msgr2=0x7f310810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.567 7f310d0c3700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 0x7f310810c340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f31000032f0 tx=0x7f3100009d40).stop 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 -- 172.21.15.73:0/3238904924 shutdown_connections 2024-03-24T10:40:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080f5920 0x7f310810c340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 --2- 172.21.15.73:0/3238904924 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f310810c970 0x7f31080f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 -- 172.21.15.73:0/3238904924 >> 172.21.15.73:0/3238904924 conn(0x7f3108113a70 msgr2=0x7f31080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 -- 172.21.15.73:0/3238904924 shutdown_connections 2024-03-24T10:40:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.568 7f310d0c3700 1 -- 172.21.15.73:0/3238904924 wait complete. 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.590 7f310d0c3700 1 Processor -- start 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.590 7f310d0c3700 1 -- start start 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 0x7f31080d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 0x7f31081b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 0x7f31081b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31080c4a70 con 0x7f31080d5470 2024-03-24T10:40:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31081b3460 con 0x7f31080d5ef0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31081a6eb0 con 0x7f31081b29e0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f3105dfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 0x7f31080d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31055fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 0x7f31081b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 0x7f31081b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f3105dfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 0x7f31080d58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38816/0 (socket says 172.21.15.73:38816) 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f3105dfc700 1 -- 172.21.15.73:0/1220660755 learned_addr learned my addr 172.21.15.73:0/1220660755 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 -- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 msgr2=0x7f31081b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 0x7f31081b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 -- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 msgr2=0x7f31080d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 0x7f31080d58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 -- 172.21.15.73:0/1220660755 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31081a4b30 con 0x7f31081b29e0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31055fb700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 0x7f31081b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f31065fd700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 0x7f31081b2e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f31080d77e0 tx=0x7f30f800c7e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31081a4b30 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f80070d0 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31081b9aa0 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30f8005620 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.591 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31081b9e80 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.592 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f30f8005820 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.592 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f30f800bb10 con 0x7f31081b29e0 2024-03-24T10:40:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.592 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31080f08e0 con 0x7f31081b29e0 2024-03-24T10:40:01.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.596 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f30f800cdd0 con 0x7f31081b29e0 2024-03-24T10:40:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.701 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31081aca60 con 0x7f31081b29e0 2024-03-24T10:40:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.702 7f30feffd700 1 -- 172.21.15.73:0/1220660755 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+5875 (secure 0 0 0) 0x7f31081145f0 con 0x7f31081b29e0 2024-03-24T10:40:01.702 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:01.702 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:39:59.232827","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 >> v1:172.21.15.73:6816/43277 conn(0x7f30ec0145b0 legacy=0x7f30ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 msgr2=0x7f31081b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 0x7f31081b2e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f31080d77e0 tx=0x7f30f800c7e0).stop 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 shutdown_connections 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f31081b29e0 0x7f31081b2e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31080d5470 0x7f31080d58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.703 7f310d0c3700 1 --2- 172.21.15.73:0/1220660755 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31080d5ef0 0x7f31081b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.704 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 >> 172.21.15.73:0/1220660755 conn(0x7f31080c59b0 msgr2=0x7f31080d6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.704 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 shutdown_connections 2024-03-24T10:40:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.704 7f310d0c3700 1 -- 172.21.15.73:0/1220660755 wait complete. 2024-03-24T10:40:01.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-03-24T10:40:01.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:40:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 Processor -- start 2024-03-24T10:40:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 -- start start 2024-03-24T10:40:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c1a0a70 con 0x7f9c6c10b740 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0fa590 con 0x7f9c6c0f5a10 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.844 7f9c7205c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1a0c90 con 0x7f9c6c10bb90 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6adc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54642/0 (socket says 172.21.15.73:54642) 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6adc6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38826/0 (socket says 172.21.15.73:38826) 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 -- 172.21.15.73:0/1241236261 learned_addr learned my addr 172.21.15.73:0/1241236261 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c69dc4700 1 -- 172.21.15.73:0/1241236261 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065902426 0 0) 0x7f9c60001110 con 0x7f9c6c10b740 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c69dc4700 1 -- 172.21.15.73:0/1241236261 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c50003270 con 0x7f9c6c10b740 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 -- 172.21.15.73:0/1241236261 >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 msgr2=0x7f9c6c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 --2- 172.21.15.73:0/1241236261 >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 -- 172.21.15.73:0/1241236261 >> v1:172.21.15.73:6789/0 conn(0x7f9c6c10b740 legacy=0x7f9c6c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 -- 172.21.15.73:0/1241236261 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c1a93d0 con 0x7f9c6c10bb90 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6adc6700 1 --2- 172.21.15.73:0/1241236261 >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c6b5c7700 1 --2- 172.21.15.73:0/1241236261 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9c6c0f47c0 tx=0x7f9c64009d90).ready entity=mon.2 client_cookie=66ad5d01e4b6587f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c69dc4700 1 -- 172.21.15.73:0/1241236261 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c6c1a93d0 con 0x7f9c6c10bb90 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c69dc4700 1 -- 172.21.15.73:0/1241236261 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400b840 con 0x7f9c6c10bb90 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c69dc4700 1 -- 172.21.15.73:0/1241236261 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c6400ba20 con 0x7f9c6c10bb90 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c7205c700 1 -- 172.21.15.73:0/1241236261 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 msgr2=0x7f9c6c1a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.845 7f9c7205c700 1 --2- 172.21.15.73:0/1241236261 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9c6c0f47c0 tx=0x7f9c64009d90).stop 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 -- 172.21.15.73:0/1241236261 shutdown_connections 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 --2- 172.21.15.73:0/1241236261 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c10bb90 0x7f9c6c1a0440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 --2- 172.21.15.73:0/1241236261 >> v2:172.21.15.73:3300/0 conn(0x7f9c6c0f5a10 0x7f9c6c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 -- 172.21.15.73:0/1241236261 >> 172.21.15.73:0/1241236261 conn(0x7f9c6c113a70 msgr2=0x7f9c6c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 -- 172.21.15.73:0/1241236261 shutdown_connections 2024-03-24T10:40:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.846 7f9c7205c700 1 -- 172.21.15.73:0/1241236261 wait complete. 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.868 7f9c7205c700 1 Processor -- start 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 -- start start 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 0x7f9c6c1aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 0x7f9c6c1b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0e0190 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1b2480 con 0x7f9c6c1ab370 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c7205c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0e0750 con 0x7f9c6c1aa8f0 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6adc6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 0x7f9c6c1aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6a5c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 0x7f9c6c1b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38830/0 (socket says 172.21.15.73:38830) 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 -- 172.21.15.73:0/2770337489 learned_addr learned my addr 172.21.15.73:0/2770337489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 -- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 msgr2=0x7f9c6c1aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 0x7f9c6c1aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 -- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 msgr2=0x7f9c6c1b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 0x7f9c6c1b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 -- 172.21.15.73:0/2770337489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0e0490 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6adc6700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 0x7f9c6c1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6a5c5700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 0x7f9c6c1b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.869 7f9c6b5c7700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9c6c0e0340 tx=0x7f9c64006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c6c0e0490 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c640119d0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c64017040 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c0d29c0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c1b8ca0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9c6401c470 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.870 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f9c64018030 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.871 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c0d2bc0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.874 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9c640117c0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.980 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c6c0f08e0 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.980 7f9c5bfff700 1 -- 172.21.15.73:0/2770337489 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c6400b630 con 0x7f9c6c1b1a00 2024-03-24T10:40:01.980 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:40:01.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 >> v1:172.21.15.73:6816/43277 conn(0x7f9c480145b0 legacy=0x7f9c48016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 msgr2=0x7f9c6c1b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9c6c0e0340 tx=0x7f9c64006c40).stop 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 shutdown_connections 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c1b1a00 0x7f9c6c1b1e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9c6c1aa8f0 0x7f9c6c1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 --2- 172.21.15.73:0/2770337489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c6c1ab370 0x7f9c6c1b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 >> 172.21.15.73:0/2770337489 conn(0x7f9c6c0c5ae0 msgr2=0x7f9c6c0d7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 shutdown_connections 2024-03-24T10:40:01.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:01.981 7f9c7205c700 1 -- 172.21.15.73:0/2770337489 wait complete. 2024-03-24T10:40:01.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-24T10:40:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 Processor -- start 2024-03-24T10:40:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 -- start start 2024-03-24T10:40:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 0x7f03501a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 0x7f03501a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03501a1de0 con 0x7f035010e8d0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0350102e00 con 0x7f03501a6ed0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f0356cfa700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03500f2250 con 0x7f03501a4440 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034effd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 0x7f03501a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f035010e8d0 0x7f035010ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60182/0 (socket says 172.21.15.73:60182) 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034f7fe700 1 -- 172.21.15.73:0/581444333 learned_addr learned my addr 172.21.15.73:0/581444333 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034ffff700 1 --2- 172.21.15.73:0/581444333 >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 0x7f03501a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034e7fc700 1 -- 172.21.15.73:0/581444333 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446998308 0 0) 0x7f03501a1de0 con 0x7f035010e8d0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034e7fc700 1 -- 172.21.15.73:0/581444333 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f033c003270 con 0x7f035010e8d0 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034effd700 1 -- 172.21.15.73:0/581444333 >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 msgr2=0x7f03501a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034effd700 1 --2- 172.21.15.73:0/581444333 >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 0x7f03501a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034effd700 1 -- 172.21.15.73:0/581444333 >> v1:172.21.15.73:6789/0 conn(0x7f035010e8d0 legacy=0x7f035010ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034effd700 1 -- 172.21.15.73:0/581444333 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500f97a0 con 0x7f03501a4440 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.120 7f034ffff700 1 --2- 172.21.15.73:0/581444333 >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 0x7f03501a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f034effd700 1 --2- 172.21.15.73:0/581444333 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 0x7f03501a68a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f034000b970).ready entity=mon.2 client_cookie=4827a7cc26553594 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f034e7fc700 1 -- 172.21.15.73:0/581444333 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03500f97a0 con 0x7f03501a4440 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f034e7fc700 1 -- 172.21.15.73:0/581444333 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000d610 con 0x7f03501a4440 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f034e7fc700 1 -- 172.21.15.73:0/581444333 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f034000d9e0 con 0x7f03501a4440 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 -- 172.21.15.73:0/581444333 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 msgr2=0x7f03501a68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 --2- 172.21.15.73:0/581444333 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 0x7f03501a68a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0340002f70 tx=0x7f034000b970).stop 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 -- 172.21.15.73:0/581444333 shutdown_connections 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 --2- 172.21.15.73:0/581444333 >> v2:172.21.15.73:3300/0 conn(0x7f03501a6ed0 0x7f03501a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 --2- 172.21.15.73:0/581444333 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501a4440 0x7f03501a68a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.121 7f0356cfa700 1 -- 172.21.15.73:0/581444333 >> 172.21.15.73:0/581444333 conn(0x7f0350112fe0 msgr2=0x7f0350113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.122 7f0356cfa700 1 -- 172.21.15.73:0/581444333 shutdown_connections 2024-03-24T10:40:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.122 7f0356cfa700 1 -- 172.21.15.73:0/581444333 wait complete. 2024-03-24T10:40:02.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 Processor -- start 2024-03-24T10:40:02.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 -- start start 2024-03-24T10:40:02.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 0x7f03501b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 0x7f03501b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500f7a70 con 0x7f03501ae220 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03501a0830 con 0x7f03501b4740 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.144 7f0356cfa700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03501a0af0 con 0x7f03501ad7a0 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034f7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 0x7f03501b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034f7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54670/0 (socket says 172.21.15.73:54670) 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034f7fe700 1 -- 172.21.15.73:0/302648666 learned_addr learned my addr 172.21.15.73:0/302648666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 0x7f03501b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 -- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 msgr2=0x7f03501adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 -- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 msgr2=0x7f03501b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 0x7f03501b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 -- 172.21.15.73:0/302648666 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03501bb890 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034f7fe700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034effd700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 0x7f03501b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034ffff700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 0x7f03501b4b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f034800c000 tx=0x7f034800ed40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03501bb890 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800c880 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f0356cfa700 1 -- 172.21.15.73:0/302648666 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03501bba90 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f034800f040 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.145 7f0356cfa700 1 -- 172.21.15.73:0/302648666 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03501bbe70 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.146 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0348022060 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.146 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f0348010040 con 0x7f03501b4740 2024-03-24T10:40:02.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.146 7f0356cfa700 1 -- 172.21.15.73:0/302648666 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03500f08e0 con 0x7f03501b4740 2024-03-24T10:40:02.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.150 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f034800c670 con 0x7f03501b4740 2024-03-24T10:40:02.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.259 7f0356cfa700 1 -- 172.21.15.73:0/302648666 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f03500e2430 con 0x7f03501b4740 2024-03-24T10:40:02.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.259 7f034cff9700 1 -- 172.21.15.73:0/302648666 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+64 (secure 0 0 0) 0x7f0350113d70 con 0x7f03501b4740 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-24T10:40:02.260 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-03-24T10:40:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 >> v1:172.21.15.73:6816/43277 conn(0x7f03300145b0 legacy=0x7f0330016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 msgr2=0x7f03501b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 0x7f03501b4b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f034800c000 tx=0x7f034800ed40).stop 2024-03-24T10:40:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 shutdown_connections 2024-03-24T10:40:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03501b4740 0x7f03501b4b90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f03501ad7a0 0x7f03501adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 --2- 172.21.15.73:0/302648666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03501ae220 0x7f03501b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 >> 172.21.15.73:0/302648666 conn(0x7f03501a55a0 msgr2=0x7f03500da7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 shutdown_connections 2024-03-24T10:40:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.261 7f0356cfa700 1 -- 172.21.15.73:0/302648666 wait complete. 2024-03-24T10:40:02.272 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-24T10:40:02.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-24T10:40:02.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 Processor -- start 2024-03-24T10:40:02.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 -- start start 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 0x7f8c701a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c701a6bd0 0x7f8c701a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7010cf80 con 0x7f8c700f5910 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700fa280 con 0x7f8c701a6bd0 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.401 7f8c75237700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700f95b0 con 0x7f8c7010cb30 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 0x7f8c701a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6e00f700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8c700f5910 0x7f8c7010c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60190/0 (socket says 172.21.15.73:60190) 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6e00f700 1 -- 172.21.15.73:0/2338211152 learned_addr learned my addr 172.21.15.73:0/2338211152 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6e810700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c701a6bd0 0x7f8c701a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 -- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c701a6bd0 msgr2=0x7f8c701a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c701a6bd0 0x7f8c701a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 -- 172.21.15.73:0/2338211152 >> v1:172.21.15.73:6789/0 conn(0x7f8c700f5910 legacy=0x7f8c7010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 -- 172.21.15.73:0/2338211152 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c701aa670 con 0x7f8c7010cb30 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d00d700 1 -- 172.21.15.73:0/2338211152 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078360664 0 0) 0x7f8c64001110 con 0x7f8c700f5910 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d80e700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 0x7f8c701a65a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8c700f4630 tx=0x7f8c6000b9d0).ready entity=mon.2 client_cookie=2170c9ec61eec7d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d00d700 1 -- 172.21.15.73:0/2338211152 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c701aa670 con 0x7f8c7010cb30 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d00d700 1 -- 172.21.15.73:0/2338211152 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000d570 con 0x7f8c7010cb30 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c6d00d700 1 -- 172.21.15.73:0/2338211152 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c6000d940 con 0x7f8c7010cb30 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c75237700 1 -- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 msgr2=0x7f8c701a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.402 7f8c75237700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 0x7f8c701a65a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8c700f4630 tx=0x7f8c6000b9d0).stop 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 -- 172.21.15.73:0/2338211152 shutdown_connections 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c701a6bd0 0x7f8c701a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 --2- 172.21.15.73:0/2338211152 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c7010cb30 0x7f8c701a65a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 -- 172.21.15.73:0/2338211152 >> 172.21.15.73:0/2338211152 conn(0x7f8c70113a60 msgr2=0x7f8c700f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 -- 172.21.15.73:0/2338211152 shutdown_connections 2024-03-24T10:40:02.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.403 7f8c75237700 1 -- 172.21.15.73:0/2338211152 wait complete. 2024-03-24T10:40:02.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 Processor -- start 2024-03-24T10:40:02.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 -- start start 2024-03-24T10:40:02.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c700d5430 0x7f8c700d5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c700d5eb0 0x7f8c700db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700c4a70 con 0x7f8c700d5eb0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701a6040 con 0x7f8c700d5430 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.426 7f8c75237700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700d7010 con 0x7f8c700db8f0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54684/0 (socket says 172.21.15.73:54684) 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 -- 172.21.15.73:0/3340027000 learned_addr learned my addr 172.21.15.73:0/3340027000 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6d80e700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c700d5eb0 0x7f8c700db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 -- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c700d5430 msgr2=0x7f8c700d5880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c700d5430 0x7f8c700d5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 -- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c700d5eb0 msgr2=0x7f8c700db2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c700d5eb0 0x7f8c700db2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 -- 172.21.15.73:0/3340027000 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700d7400 con 0x7f8c700db8f0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c6e810700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8c700dcad0 tx=0x7f8c6800ee20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c700d7400 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800c900 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c6800f040 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c75237700 1 -- 172.21.15.73:0/3340027000 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c700dbd40 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.427 7f8c75237700 1 -- 172.21.15.73:0/3340027000 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c701ba040 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.428 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8c68022060 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.428 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f8c68010040 con 0x7f8c700db8f0 2024-03-24T10:40:02.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.428 7f8c75237700 1 -- 172.21.15.73:0/3340027000 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700f08d0 con 0x7f8c700db8f0 2024-03-24T10:40:02.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.432 7f8c5f7fe700 1 -- 172.21.15.73:0/3340027000 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8c6800c6f0 con 0x7f8c700db8f0 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 >> v1:172.21.15.73:6816/43277 conn(0x7f8c4c0145b0 legacy=0x7f8c4c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 msgr2=0x7f8c701b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8c700dcad0 tx=0x7f8c6800ee20).stop 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 shutdown_connections 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8c700db8f0 0x7f8c701b9a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8c700d5430 0x7f8c700d5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 --2- 172.21.15.73:0/3340027000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c700d5eb0 0x7f8c700db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 >> 172.21.15.73:0/3340027000 conn(0x7f8c700c90c0 msgr2=0x7f8c700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 shutdown_connections 2024-03-24T10:40:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.538 7f8c75237700 1 -- 172.21.15.73:0/3340027000 wait complete. 2024-03-24T10:40:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:Invalid command: missing required parameter pg_num() 2024-03-24T10:40:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool create {} {replicated|erasure} {} {} {} {} {} {} {} : create pool 2024-03-24T10:40:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:40:02.551 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:40:02.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 2024-03-24T10:40:02.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 Processor -- start 2024-03-24T10:40:02.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 -- start start 2024-03-24T10:40:02.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40f2640 con 0x7fd3c410cd40 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40fa210 con 0x7fd3c40f58a0 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c8c5a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40f9540 con 0x7fd3c410c8f0 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c104f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c104f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54690/0 (socket says 172.21.15.73:54690) 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39972/0 (socket says 172.21.15.73:39972) 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c104f700 1 -- 172.21.15.73:0/892385549 learned_addr learned my addr 172.21.15.73:0/892385549 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.680 7fd3c2051700 1 --1- 172.21.15.73:0/892385549 >> v1:172.21.15.73:6789/0 conn(0x7fd3c410cd40 0x7fd3c40f1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60192/0 (socket says 172.21.15.73:60192) 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c084e700 1 -- 172.21.15.73:0/892385549 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129082461 0 0) 0x7fd3bc001490 con 0x7fd3c410cd40 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c1850700 1 -- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 msgr2=0x7fd3c40f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c1850700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c1850700 1 -- 172.21.15.73:0/892385549 >> v1:172.21.15.73:6789/0 conn(0x7fd3c410cd40 legacy=0x7fd3c40f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c1850700 1 -- 172.21.15.73:0/892385549 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c41aa560 con 0x7fd3c40f58a0 2024-03-24T10:40:02.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c104f700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c1850700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd3b4002f70 tx=0x7fd3b400ba20).ready entity=mon.1 client_cookie=557747113dd9ddd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c084e700 1 -- 172.21.15.73:0/892385549 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3c41aa560 con 0x7fd3c40f58a0 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c084e700 1 -- 172.21.15.73:0/892385549 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400d570 con 0x7fd3c40f58a0 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c084e700 1 -- 172.21.15.73:0/892385549 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3b400d940 con 0x7fd3c40f58a0 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c8c5a700 1 -- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 msgr2=0x7fd3c410c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.681 7fd3c8c5a700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd3b4002f70 tx=0x7fd3b400ba20).stop 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 -- 172.21.15.73:0/892385549 shutdown_connections 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40f58a0 0x7fd3c410c2c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 --2- 172.21.15.73:0/892385549 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c410c8f0 0x7fd3c40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 -- 172.21.15.73:0/892385549 >> 172.21.15.73:0/892385549 conn(0x7fd3c41139f0 msgr2=0x7fd3c40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 -- 172.21.15.73:0/892385549 shutdown_connections 2024-03-24T10:40:02.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.682 7fd3c8c5a700 1 -- 172.21.15.73:0/892385549 wait complete. 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.704 7fd3c8c5a700 1 Processor -- start 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.704 7fd3c8c5a700 1 -- start start 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 0x7fd3c41b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 0x7fd3c41b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40d7b90 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41b3220 con 0x7fd3c40d6340 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c4910 con 0x7fd3c41b27a0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 0x7fd3c41b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c2051700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 0x7fd3c41b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39978/0 (socket says 172.21.15.73:39978) 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c1850700 1 -- 172.21.15.73:0/2111912270 learned_addr learned my addr 172.21.15.73:0/2111912270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 -- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 msgr2=0x7fd3c41b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 0x7fd3c41b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 -- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 msgr2=0x7fd3c40d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 -- 172.21.15.73:0/2111912270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c41a7060 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c1850700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c2051700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 0x7fd3c41b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c104f700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 0x7fd3c41b2170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd3c40d7930 tx=0x7fd3ac00eaa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3c41a7060 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac012600 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3ac00f040 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40d83a0 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.705 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c41b98e0 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.706 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd3ac022060 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.706 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fd3ac010040 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.707 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c40f0860 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.710 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd3ac0123f0 con 0x7fd3c40d6dc0 2024-03-24T10:40:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:02.814 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64} v 0) v1 -- 0x7fd3c41ac890 con 0x7fd3c40d6dc0 2024-03-24T10:40:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.431 7fd3baffd700 1 -- 172.21.15.73:0/2111912270 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd3ac000c30 con 0x7fd3c40d6dc0 2024-03-24T10:40:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.436 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 >> v1:172.21.15.73:6816/43277 conn(0x7fd3a80145b0 legacy=0x7fd3a8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.436 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 msgr2=0x7fd3c41b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.436 7fd3c8c5a700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 0x7fd3c41b2170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd3c40d7930 tx=0x7fd3ac00eaa0).stop 2024-03-24T10:40:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.437 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 shutdown_connections 2024-03-24T10:40:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.437 7fd3c8c5a700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd3c41b27a0 0x7fd3c41b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.437 7fd3c8c5a700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3c40d6340 0x7fd3c40d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.437 7fd3c8c5a700 1 --2- 172.21.15.73:0/2111912270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c40d6dc0 0x7fd3c41b2170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.437 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 >> 172.21.15.73:0/2111912270 conn(0x7fd3c40c6c70 msgr2=0x7fd3c40c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.438 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 shutdown_connections 2024-03-24T10:40:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.438 7fd3c8c5a700 1 -- 172.21.15.73:0/2111912270 wait complete. 2024-03-24T10:40:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-03-24T10:40:03.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 64 2024-03-24T10:40:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 Processor -- start 2024-03-24T10:40:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 -- start start 2024-03-24T10:40:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00f9220 con 0x7f7ea00f5910 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea00f24d0 con 0x7f7ea00f2080 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea7be3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01ac710 con 0x7f7ea01a8c70 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7e9ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39992/0 (socket says 172.21.15.73:39992) 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 -- 172.21.15.73:0/4083128600 learned_addr learned my addr 172.21.15.73:0/4083128600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7e9ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38888/0 (socket says 172.21.15.73:38888) 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea49de700 1 --1- 172.21.15.73:0/4083128600 >> v1:172.21.15.73:6789/0 conn(0x7f7ea00f5910 0x7f7ea00f1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60194/0 (socket says 172.21.15.73:60194) 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 -- 172.21.15.73:0/4083128600 >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 msgr2=0x7f7ea01a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 --2- 172.21.15.73:0/4083128600 >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.590 7f7ea51df700 1 -- 172.21.15.73:0/4083128600 >> v1:172.21.15.73:6789/0 conn(0x7f7ea00f5910 legacy=0x7f7ea00f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7e9f7fe700 1 -- 172.21.15.73:0/4083128600 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326956076 0 0) 0x7f7e94001110 con 0x7f7ea00f5910 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea51df700 1 -- 172.21.15.73:0/4083128600 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea01ac8c0 con 0x7f7ea01a8c70 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7e9ffff700 1 --2- 172.21.15.73:0/4083128600 >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea51df700 1 --2- 172.21.15.73:0/4083128600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7e980032f0 tx=0x7f7e98009d60).ready entity=mon.1 client_cookie=a8539e02f209efb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7e9f7fe700 1 -- 172.21.15.73:0/4083128600 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ea01ac8c0 con 0x7f7ea01a8c70 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7e9f7fe700 1 -- 172.21.15.73:0/4083128600 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9800b880 con 0x7f7ea01a8c70 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7e9f7fe700 1 -- 172.21.15.73:0/4083128600 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e9800ba60 con 0x7f7ea01a8c70 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 -- 172.21.15.73:0/4083128600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 msgr2=0x7f7ea01ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 --2- 172.21.15.73:0/4083128600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7e980032f0 tx=0x7f7e98009d60).stop 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 -- 172.21.15.73:0/4083128600 shutdown_connections 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 --2- 172.21.15.73:0/4083128600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea01a8c70 0x7f7ea01ab0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 --2- 172.21.15.73:0/4083128600 >> v2:172.21.15.73:3300/0 conn(0x7f7ea00f2080 0x7f7ea01a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.591 7f7ea7be3700 1 -- 172.21.15.73:0/4083128600 >> 172.21.15.73:0/4083128600 conn(0x7f7ea0113a60 msgr2=0x7f7ea00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.592 7f7ea7be3700 1 -- 172.21.15.73:0/4083128600 shutdown_connections 2024-03-24T10:40:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.592 7f7ea7be3700 1 -- 172.21.15.73:0/4083128600 wait complete. 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.614 7f7ea7be3700 1 Processor -- start 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.614 7f7ea7be3700 1 -- start start 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 0x7f7ea00d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 0x7f7ea01b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00d7600 con 0x7f7ea00d6730 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00bec60 con 0x7f7ea00d71b0 2024-03-24T10:40:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00be610 con 0x7f7ea01b4f70 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea49de700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 0x7f7ea00d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39996/0 (socket says 172.21.15.73:39996) 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea51df700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 0x7f7ea01b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 -- 172.21.15.73:0/2886934557 learned_addr learned my addr 172.21.15.73:0/2886934557 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 -- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 msgr2=0x7f7ea01b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 0x7f7ea01b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 -- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 msgr2=0x7f7ea00d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 0x7f7ea00d6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 -- 172.21.15.73:0/2886934557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00d2b90 con 0x7f7ea00d71b0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea51df700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 0x7f7ea01b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea49de700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 0x7f7ea00d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9ffff700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7e8c00c000 tx=0x7f7e8c00ebc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ea00d2b90 con 0x7f7ea00d71b0 2024-03-24T10:40:03.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00c7f0 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e8c00f040 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea01bbed0 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.615 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea01bc2b0 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.616 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7e8c011070 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.616 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 2728+0+0 (secure 0 0 0) 0x7f7e8c010040 con 0x7f7ea00d71b0 2024-03-24T10:40:03.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.616 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea00f08d0 con 0x7f7ea00d71b0 2024-03-24T10:40:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.619 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7e8c00c3f0 con 0x7f7ea00d71b0 2024-03-24T10:40:03.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:03.724 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f7ea00ceee0 con 0x7f7ea00d71b0 2024-03-24T10:40:04.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.434 7f7e9dffb700 1 -- 172.21.15.73:0/2886934557 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64}]=0 pool 'cephfs_data' created v23) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e8c000c30 con 0x7f7ea00d71b0 2024-03-24T10:40:04.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.439 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 >> v1:172.21.15.73:6816/43277 conn(0x7f7e880145b0 legacy=0x7f7e88016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.439 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 msgr2=0x7f7ea01b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.439 7f7ea7be3700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7e8c00c000 tx=0x7f7e8c00ebc0).stop 2024-03-24T10:40:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.441 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 shutdown_connections 2024-03-24T10:40:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.441 7f7ea7be3700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7ea01b4f70 0x7f7ea01b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.441 7f7ea7be3700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea00d6730 0x7f7ea00d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.441 7f7ea7be3700 1 --2- 172.21.15.73:0/2886934557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ea00d71b0 0x7f7ea01b4940 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.441 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 >> 172.21.15.73:0/2886934557 conn(0x7f7ea00dc7e0 msgr2=0x7f7ea00bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.448 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 shutdown_connections 2024-03-24T10:40:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.452 7f7ea7be3700 1 -- 172.21.15.73:0/2886934557 wait complete. 2024-03-24T10:40:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-03-24T10:40:04.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-24T10:40:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 Processor -- start 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 -- start start 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6a81a72b0 0x7fc6a81a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80f3a20 con 0x7fc6a80f1970 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.610 7fc6ace6d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80fa1f0 con 0x7fc6a81a72b0 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6ace6d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80f95a0 con 0x7fc6a810c780 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40012/0 (socket says 172.21.15.73:40012) 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 -- 172.21.15.73:0/455973782 learned_addr learned my addr 172.21.15.73:0/455973782 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a6365700 1 --2- 172.21.15.73:0/455973782 >> v2:172.21.15.73:3300/0 conn(0x7fc6a81a72b0 0x7fc6a81a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 -- 172.21.15.73:0/455973782 >> v2:172.21.15.73:3300/0 conn(0x7fc6a81a72b0 msgr2=0x7fc6a81a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 --2- 172.21.15.73:0/455973782 >> v2:172.21.15.73:3300/0 conn(0x7fc6a81a72b0 0x7fc6a81a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 -- 172.21.15.73:0/455973782 >> v1:172.21.15.73:6789/0 conn(0x7fc6a80f1970 legacy=0x7fc6a80f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 -- 172.21.15.73:0/455973782 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8110ca0 con 0x7fc6a810c780 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a5b64700 1 --2- 172.21.15.73:0/455973782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc698002f70 tx=0x7fc6980099d0).ready entity=mon.1 client_cookie=c4ed9ce503fbe3af server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a4b62700 1 -- 172.21.15.73:0/455973782 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc69800f510 con 0x7fc6a810c780 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a4b62700 1 -- 172.21.15.73:0/455973782 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69800f710 con 0x7fc6a810c780 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6a4b62700 1 -- 172.21.15.73:0/455973782 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc69800f8f0 con 0x7fc6a810c780 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6ace6d700 1 -- 172.21.15.73:0/455973782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 msgr2=0x7fc6a810cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.611 7fc6ace6d700 1 --2- 172.21.15.73:0/455973782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc698002f70 tx=0x7fc6980099d0).stop 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 -- 172.21.15.73:0/455973782 shutdown_connections 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 --2- 172.21.15.73:0/455973782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a810c780 0x7fc6a810cbd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 --2- 172.21.15.73:0/455973782 >> v2:172.21.15.73:3300/0 conn(0x7fc6a81a72b0 0x7fc6a81a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 -- 172.21.15.73:0/455973782 >> 172.21.15.73:0/455973782 conn(0x7fc6a8113a80 msgr2=0x7fc6a80f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 -- 172.21.15.73:0/455973782 shutdown_connections 2024-03-24T10:40:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.612 7fc6ace6d700 1 -- 172.21.15.73:0/455973782 wait complete. 2024-03-24T10:40:04.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.634 7fc6ace6d700 1 Processor -- start 2024-03-24T10:40:04.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.634 7fc6ace6d700 1 -- start start 2024-03-24T10:40:04.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc6a81b4b20 0x7fc6a81b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80f2a20 con 0x7fc6a81ad930 2024-03-24T10:40:04.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c4d40 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80d4570 con 0x7fc6a81b4b20 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5b64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5b64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38914/0 (socket says 172.21.15.73:38914) 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40022/0 (socket says 172.21.15.73:40022) 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5b64700 1 -- 172.21.15.73:0/2467328369 learned_addr learned my addr 172.21.15.73:0/2467328369 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a6365700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc6a81b4b20 0x7fc6a81b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 -- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc6a81b4b20 msgr2=0x7fc6a81b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc6a81b4b20 0x7fc6a81b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 -- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 msgr2=0x7fc6a81add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 -- 172.21.15.73:0/2467328369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80d48c0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5b64700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6a5363700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc6a80c5f90 tx=0x7fc69c00c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:04.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6a80d48c0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c012400 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a80df430 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.635 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc69c0127d0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.636 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a81bbdc0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.636 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc69c01b3b0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.636 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3078+0+0 (secure 0 0 0) 0x7fc69c00bd50 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.637 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a80f08e0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.640 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc69c00cdb0 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.775 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc6a80e2430 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.792 7fc696ffd700 1 -- 172.21.15.73:0/2467328369 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc69c000c30 con 0x7fc6a81ae3b0 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.797 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 >> v1:172.21.15.73:6816/43277 conn(0x7fc6840145b0 legacy=0x7fc684016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 msgr2=0x7fc6a81b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc6a80c5f90 tx=0x7fc69c00c7e0).stop 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 shutdown_connections 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc6a81b4b20 0x7fc6a81b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6a81ad930 0x7fc6a81add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 --2- 172.21.15.73:0/2467328369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6a81ae3b0 0x7fc6a81b44f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 >> 172.21.15.73:0/2467328369 conn(0x7fc6a80c9430 msgr2=0x7fc6a80d7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 shutdown_connections 2024-03-24T10:40:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.798 7fc6ace6d700 1 -- 172.21.15.73:0/2467328369 wait complete. 2024-03-24T10:40:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 4 and data pool 5 2024-03-24T10:40:04.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 Processor -- start 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 -- start start 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2b40f1d10 0x7fa2b410e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b40f9080 con 0x7fa2b40f1d10 2024-03-24T10:40:04.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b410ed60 con 0x7fa2b40f5770 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2bafa1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41aa4b0 con 0x7fa2b40f2160 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b8ffe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b97ff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b97ff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54728/0 (socket says 172.21.15.73:54728) 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2b40f1d10 0x7fa2b410e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b8ffe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40036/0 (socket says 172.21.15.73:40036) 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.944 7fa2b97ff700 1 -- 172.21.15.73:0/4242504211 learned_addr learned my addr 172.21.15.73:0/4242504211 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 -- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 msgr2=0x7fa2b40f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 -- 172.21.15.73:0/4242504211 >> v2:172.21.15.73:3300/0 conn(0x7fa2b40f1d10 msgr2=0x7fa2b410e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 --2- 172.21.15.73:0/4242504211 >> v2:172.21.15.73:3300/0 conn(0x7fa2b40f1d10 0x7fa2b410e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 -- 172.21.15.73:0/4242504211 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b41aa660 con 0x7fa2b40f2160 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b8ffe700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:04.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b97ff700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac009d60).ready entity=mon.2 client_cookie=e690432e7817f594 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b37fe700 1 -- 172.21.15.73:0/4242504211 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2b41aa660 con 0x7fa2b40f2160 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b37fe700 1 -- 172.21.15.73:0/4242504211 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac00b880 con 0x7fa2b40f2160 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2b37fe700 1 -- 172.21.15.73:0/4242504211 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2ac00ba60 con 0x7fa2b40f2160 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2bafa1700 1 -- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 msgr2=0x7fa2b410e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.945 7fa2bafa1700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac009d60).stop 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 -- 172.21.15.73:0/4242504211 shutdown_connections 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40f2160 0x7fa2b410e730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 --2- 172.21.15.73:0/4242504211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40f5770 0x7fa2b40f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 --2- 172.21.15.73:0/4242504211 >> v2:172.21.15.73:3300/0 conn(0x7fa2b40f1d10 0x7fa2b410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 -- 172.21.15.73:0/4242504211 >> 172.21.15.73:0/4242504211 conn(0x7fa2b41138c0 msgr2=0x7fa2b40f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 -- 172.21.15.73:0/4242504211 shutdown_connections 2024-03-24T10:40:04.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.946 7fa2bafa1700 1 -- 172.21.15.73:0/4242504211 wait complete. 2024-03-24T10:40:04.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.968 7fa2bafa1700 1 Processor -- start 2024-03-24T10:40:04.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.968 7fa2bafa1700 1 -- start start 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 0x7fa2b41b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 0x7fa2b41b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40bdec0 con 0x7fa2b41b4360 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40e0690 con 0x7fa2b40d08f0 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2bafa1700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40bd0c0 con 0x7fa2b40d1370 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 0x7fa2b41b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40038/0 (socket says 172.21.15.73:40038) 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 -- 172.21.15.73:0/2623360983 learned_addr learned my addr 172.21.15.73:0/2623360983 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b97ff700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 0x7fa2b41b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 -- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 msgr2=0x7fa2b41b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 0x7fa2b41b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 -- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 msgr2=0x7fa2b41b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 0x7fa2b41b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b8ffe700 1 -- 172.21.15.73:0/2623360983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b41bb420 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b3fff700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 0x7fa2b41b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.969 7fa2b97ff700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 0x7fa2b41b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b8ffe700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa2a400c000 tx=0x7fa2a400ec40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2b41bb420 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400c9a0 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b41bb620 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2a400f040 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b41bba00 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa2a4011070 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.970 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa2a4010040 con 0x7fa2b40d08f0 2024-03-24T10:40:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.971 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b40f0730 con 0x7fa2b40d08f0 2024-03-24T10:40:04.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:04.974 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa2a400c5a0 con 0x7fa2b40d08f0 2024-03-24T10:40:05.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.079 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2b40d44e0 con 0x7fa2b40d08f0 2024-03-24T10:40:05.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.080 7fa2b1ffb700 1 -- 172.21.15.73:0/2623360983 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+8745 (secure 0 0 0) 0x7fa2a4000c30 con 0x7fa2b40d08f0 2024-03-24T10:40:05.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:05.080 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:04.777351","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:05.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 >> v1:172.21.15.73:6816/43277 conn(0x7fa2980145b0 legacy=0x7fa298016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 msgr2=0x7fa2b40d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa2a400c000 tx=0x7fa2a400ec40).stop 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 shutdown_connections 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b41b4360 0x7fa2b41b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2b40d08f0 0x7fa2b40d0d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 --2- 172.21.15.73:0/2623360983 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2b40d1370 0x7fa2b41b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 >> 172.21.15.73:0/2623360983 conn(0x7fa2b40c56a0 msgr2=0x7fa2b40c2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 shutdown_connections 2024-03-24T10:40:05.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.081 7fa2bafa1700 1 -- 172.21.15.73:0/2623360983 wait complete. 2024-03-24T10:40:05.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.218 7fa24adb5700 1 Processor -- start 2024-03-24T10:40:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.218 7fa24adb5700 1 -- start start 2024-03-24T10:40:05.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa24adb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 0x7fa24410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa24adb5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 0x7fa2441a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa24adb5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2441a0a70 con 0x7fa24410b740 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa24adb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440fa590 con 0x7fa2440f5a10 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa24adb5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441a0c90 con 0x7fa24410bb90 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 0x7fa2441a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa242ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa24410b740 0x7fa24419fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60214/0 (socket says 172.21.15.73:60214) 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa242ffd700 1 -- 172.21.15.73:0/210143311 learned_addr learned my addr 172.21.15.73:0/210143311 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa2427fc700 1 -- 172.21.15.73:0/210143311 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408726544 0 0) 0x7fa234001110 con 0x7fa24410b740 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa2427fc700 1 -- 172.21.15.73:0/210143311 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa224003270 con 0x7fa24410b740 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa2437fe700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 0x7fa24410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 -- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 msgr2=0x7fa24410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 0x7fa24410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 -- 172.21.15.73:0/210143311 >> v1:172.21.15.73:6789/0 conn(0x7fa24410b740 legacy=0x7fa24419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 -- 172.21.15.73:0/210143311 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2441a93d0 con 0x7fa24410bb90 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa2437fe700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 0x7fa24410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa243fff700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 0x7fa2441a0440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2440f47c0 tx=0x7fa23c009cf0).ready entity=mon.2 client_cookie=652ba713951ef628 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.219 7fa2427fc700 1 -- 172.21.15.73:0/210143311 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2441a93d0 con 0x7fa24410bb90 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa2427fc700 1 -- 172.21.15.73:0/210143311 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00b840 con 0x7fa24410bb90 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa2427fc700 1 -- 172.21.15.73:0/210143311 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23c00ba20 con 0x7fa24410bb90 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 -- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 msgr2=0x7fa2441a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 0x7fa2441a0440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2440f47c0 tx=0x7fa23c009cf0).stop 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 -- 172.21.15.73:0/210143311 shutdown_connections 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa24410bb90 0x7fa2441a0440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 --2- 172.21.15.73:0/210143311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440f5a10 0x7fa24410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 -- 172.21.15.73:0/210143311 >> 172.21.15.73:0/210143311 conn(0x7fa244113a70 msgr2=0x7fa2440f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 -- 172.21.15.73:0/210143311 shutdown_connections 2024-03-24T10:40:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.220 7fa24adb5700 1 -- 172.21.15.73:0/210143311 wait complete. 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.243 7fa24adb5700 1 Processor -- start 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.243 7fa24adb5700 1 -- start start 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.243 7fa24adb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.243 7fa24adb5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 0x7fa2441b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 0x7fa2441b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440e6530 con 0x7fa2440d7e30 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440d8cb0 con 0x7fa2440d73b0 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440c59e0 con 0x7fa2441b27f0 2024-03-24T10:40:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa2437fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 0x7fa2441b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa2437fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40048/0 (socket says 172.21.15.73:40048) 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa2437fe700 1 -- 172.21.15.73:0/1463841127 learned_addr learned my addr 172.21.15.73:0/1463841127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa242ffd700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 0x7fa2441b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 -- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 msgr2=0x7fa2440d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 -- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 msgr2=0x7fa2441b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 0x7fa2441b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 -- 172.21.15.73:0/1463841127 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440d9810 con 0x7fa2441b27f0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa2437fe700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa242ffd700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 0x7fa2441b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa243fff700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 0x7fa2441b2c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa2441a72c0 tx=0x7fa23c006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa2440d9810 con 0x7fa2441b27f0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c011ae0 con 0x7fa2441b27f0 2024-03-24T10:40:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2441b98b0 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa23c017040 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.244 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2441b9ab0 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.245 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa23c01c470 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.245 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa23c018030 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.245 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440f08e0 con 0x7fa2441b27f0 2024-03-24T10:40:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.248 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa23c0118d0 con 0x7fa2441b27f0 2024-03-24T10:40:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.353 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2440e2430 con 0x7fa2441b27f0 2024-03-24T10:40:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.354 7fa240ff9700 1 -- 172.21.15.73:0/1463841127 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+8745 (secure 0 0 0) 0x7fa23c037240 con 0x7fa2441b27f0 2024-03-24T10:40:05.354 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:05.355 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:04.777351","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 >> v1:172.21.15.73:6816/43277 conn(0x7fa2280145b0 legacy=0x7fa228016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 msgr2=0x7fa2441b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 0x7fa2441b2c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa2441a72c0 tx=0x7fa23c006c40).stop 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 shutdown_connections 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa2441b27f0 0x7fa2441b2c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa2440d73b0 0x7fa2440d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 --2- 172.21.15.73:0/1463841127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2440d7e30 0x7fa2441b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 >> 172.21.15.73:0/1463841127 conn(0x7fa2440c54c0 msgr2=0x7fa2440cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 shutdown_connections 2024-03-24T10:40:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.355 7fa24adb5700 1 -- 172.21.15.73:0/1463841127 wait complete. 2024-03-24T10:40:05.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-24T10:40:05.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 Processor -- start 2024-03-24T10:40:05.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 -- start start 2024-03-24T10:40:05.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 0x7f28d010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 0x7f28d01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d01a0a70 con 0x7f28d010b740 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00fa590 con 0x7f28d00f5a10 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28d5c29700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01a0c90 con 0x7f28d010bb90 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28cf05e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 0x7f28d01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28ce85d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 0x7f28d010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28ce05c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28d010b740 0x7f28d019fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60216/0 (socket says 172.21.15.73:60216) 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.497 7f28ce05c700 1 -- 172.21.15.73:0/3904260916 learned_addr learned my addr 172.21.15.73:0/3904260916 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cf05e700 1 -- 172.21.15.73:0/3904260916 >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 msgr2=0x7f28d010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cf05e700 1 --2- 172.21.15.73:0/3904260916 >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 0x7f28d010b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cf05e700 1 -- 172.21.15.73:0/3904260916 >> v1:172.21.15.73:6789/0 conn(0x7f28d010b740 legacy=0x7f28d019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cd85b700 1 -- 172.21.15.73:0/3904260916 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447457998 0 0) 0x7f28c4001110 con 0x7f28d010b740 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cf05e700 1 -- 172.21.15.73:0/3904260916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d01a93d0 con 0x7f28d010bb90 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28ce85d700 1 --2- 172.21.15.73:0/3904260916 >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 0x7f28d010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cf05e700 1 --2- 172.21.15.73:0/3904260916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 0x7f28d01a0440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f28d00f47c0 tx=0x7f28c8009cc0).ready entity=mon.1 client_cookie=7818db0fef4a460f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cd85b700 1 -- 172.21.15.73:0/3904260916 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28d01a93d0 con 0x7f28d010bb90 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cd85b700 1 -- 172.21.15.73:0/3904260916 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800b840 con 0x7f28d010bb90 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28cd85b700 1 -- 172.21.15.73:0/3904260916 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28c800ba20 con 0x7f28d010bb90 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28d5c29700 1 -- 172.21.15.73:0/3904260916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 msgr2=0x7f28d01a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.498 7f28d5c29700 1 --2- 172.21.15.73:0/3904260916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 0x7f28d01a0440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f28d00f47c0 tx=0x7f28c8009cc0).stop 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 -- 172.21.15.73:0/3904260916 shutdown_connections 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 --2- 172.21.15.73:0/3904260916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d010bb90 0x7f28d01a0440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 --2- 172.21.15.73:0/3904260916 >> v2:172.21.15.73:3300/0 conn(0x7f28d00f5a10 0x7f28d010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 -- 172.21.15.73:0/3904260916 >> 172.21.15.73:0/3904260916 conn(0x7f28d0113a70 msgr2=0x7f28d00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 -- 172.21.15.73:0/3904260916 shutdown_connections 2024-03-24T10:40:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.499 7f28d5c29700 1 -- 172.21.15.73:0/3904260916 wait complete. 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.521 7f28d5c29700 1 Processor -- start 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.521 7f28d5c29700 1 -- start start 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 0x7f28d00d7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 0x7f28d01b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce85d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 0x7f28d00d7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce85d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 0x7f28d00d7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54754/0 (socket says 172.21.15.73:54754) 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 0x7f28d01b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28d00d7ec0 0x7f28d01b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce85d700 1 -- 172.21.15.73:0/72103330 learned_addr learned my addr 172.21.15.73:0/72103330 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00e29d0 con 0x7f28d00d7ec0 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00dc650 con 0x7f28d00d7a70 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00dc410 con 0x7f28d00dcd10 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28cf05e700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28d00d7ec0 0x7f28d01b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 -- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 msgr2=0x7f28d00d7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 0x7f28d00d7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 -- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28d00d7ec0 msgr2=0x7f28d01b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28d00d7ec0 0x7f28d01b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d01b2d50 con 0x7f28d00d7a70 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.522 7f28ce05c700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 0x7f28d01b20f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f28d00c6470 tx=0x7f28c400c830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28d01b2d50 con 0x7f28d00d7a70 2024-03-24T10:40:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40070d0 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d01b3070 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28c4005620 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d01b99c0 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f28c4005a30 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.523 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f28c4014800 con 0x7f28d00d7a70 2024-03-24T10:40:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.524 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d00f08e0 con 0x7f28d00d7a70 2024-03-24T10:40:05.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.527 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f28c4005820 con 0x7f28d00d7a70 2024-03-24T10:40:05.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.663 7f28d5c29700 1 -- 172.21.15.73:0/72103330 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f28d01ac7f0 con 0x7f28d00d7a70 2024-03-24T10:40:05.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.782 7f28bffff700 1 -- 172.21.15.73:0/72103330 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7f28c4000c30 con 0x7f28d00d7a70 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 -- 172.21.15.73:0/72103330 >> v1:172.21.15.73:6816/43277 conn(0x7f28ac0145b0 legacy=0x7f28ac016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 -- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 msgr2=0x7f28d01b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 0x7f28d01b20f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f28d00c6470 tx=0x7f28c400c830).stop 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 -- 172.21.15.73:0/72103330 shutdown_connections 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28d00d7ec0 0x7f28d01b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f28d00dcd10 0x7f28d00d7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 --2- 172.21.15.73:0/72103330 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28d00d7a70 0x7f28d01b20f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 -- 172.21.15.73:0/72103330 >> 172.21.15.73:0/72103330 conn(0x7f28d00c54f0 msgr2=0x7f28d00c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.785 7f28d5c29700 1 -- 172.21.15.73:0/72103330 shutdown_connections 2024-03-24T10:40:05.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.786 7f28d5c29700 1 -- 172.21.15.73:0/72103330 wait complete. 2024-03-24T10:40:05.797 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-24T10:40:05.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-24T10:40:05.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.925 7f400f7c5700 1 Processor -- start 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.925 7f400f7c5700 1 -- start start 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40080f5a10 0x7f400810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40081a0a70 con 0x7f400810b740 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080fa590 con 0x7f40080f5a10 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40081a0c90 con 0x7f400810bb90 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400cdc1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40080f5a10 0x7f400810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400cdc1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54768/0 (socket says 172.21.15.73:54768) 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400cdc1700 1 -- 172.21.15.73:0/3817692133 learned_addr learned my addr 172.21.15.73:0/3817692133 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 -- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 msgr2=0x7f40081a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 -- 172.21.15.73:0/3817692133 >> v1:172.21.15.73:6789/0 conn(0x7f400810b740 legacy=0x7f400819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 -- 172.21.15.73:0/3817692133 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40081a93d0 con 0x7f40080f5a10 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f40077fe700 1 -- 172.21.15.73:0/3817692133 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611225547 0 0) 0x7f3ff0001110 con 0x7f400810b740 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400cdc1700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f4007fff700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080f5a10 0x7f400810b110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4008103a10 tx=0x7f3ff800ba20).ready entity=mon.0 client_cookie=7c19c31c8e4bc347 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f40077fe700 1 -- 172.21.15.73:0/3817692133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40081a93d0 con 0x7f40080f5a10 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f40077fe700 1 -- 172.21.15.73:0/3817692133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800d5c0 con 0x7f40080f5a10 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f40077fe700 1 -- 172.21.15.73:0/3817692133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3ff800d990 con 0x7f40080f5a10 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 -- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080f5a10 msgr2=0x7f400810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.926 7f400f7c5700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080f5a10 0x7f400810b110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4008103a10 tx=0x7f3ff800ba20).stop 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 -- 172.21.15.73:0/3817692133 shutdown_connections 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f400810bb90 0x7f40081a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 --2- 172.21.15.73:0/3817692133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080f5a10 0x7f400810b110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 -- 172.21.15.73:0/3817692133 >> 172.21.15.73:0/3817692133 conn(0x7f4008113a70 msgr2=0x7f40080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:05.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 -- 172.21.15.73:0/3817692133 shutdown_connections 2024-03-24T10:40:05.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.927 7f400f7c5700 1 -- 172.21.15.73:0/3817692133 wait complete. 2024-03-24T10:40:05.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 Processor -- start 2024-03-24T10:40:05.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 -- start start 2024-03-24T10:40:05.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 0x7f40081ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 0x7f40080ded50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080d5820 con 0x7f40080df380 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080e0590 con 0x7f40081aea90 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400f7c5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40080d5520 con 0x7f40081ae010 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f4007fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 0x7f40081ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400cdc1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f3ffffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 0x7f40080ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f3ffffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 0x7f40080ded50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40088/0 (socket says 172.21.15.73:40088) 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f4007fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 0x7f40081ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54782/0 (socket says 172.21.15.73:54782) 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f400cdc1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38978/0 (socket says 172.21.15.73:38978) 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.950 7f3ffffff700 1 -- 172.21.15.73:0/1841494645 learned_addr learned my addr 172.21.15.73:0/1841494645 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 -- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 msgr2=0x7f40081ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 0x7f40081ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 -- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 msgr2=0x7f40080ded50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:05.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 0x7f40080ded50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 -- 172.21.15.73:0/1841494645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080d5000 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400cdc1700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f400000e000 tx=0x7f400000d630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40080d5000 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000ddd0 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080df7d0 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4000010630 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.951 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40081bc850 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.952 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4000010830 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.952 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4000006770 con 0x7f40080df380 2024-03-24T10:40:05.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.952 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40080f08e0 con 0x7f40080df380 2024-03-24T10:40:05.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:05.955 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f400000dbc0 con 0x7f40080df380 2024-03-24T10:40:06.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.091 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f40081af1d0 con 0x7f40080df380 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.783 7f4005ffb700 1 -- 172.21.15.73:0/1841494645 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40081145f0 con 0x7f40080df380 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.785 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 >> v1:172.21.15.73:6816/43277 conn(0x7f3fec0145b0 legacy=0x7f3fec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.785 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 msgr2=0x7f40081bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.785 7f400f7c5700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f400000e000 tx=0x7f400000d630).stop 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 shutdown_connections 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40080df380 0x7f40081bc220 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f40081ae010 0x7f40081ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 --2- 172.21.15.73:0/1841494645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40081aea90 0x7f40080ded50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 >> 172.21.15.73:0/1841494645 conn(0x7f40081a8060 msgr2=0x7f40080daca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:06.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 shutdown_connections 2024-03-24T10:40:06.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.786 7f400f7c5700 1 -- 172.21.15.73:0/1841494645 wait complete. 2024-03-24T10:40:06.800 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-24T10:40:06.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.938 7f5cb1dd2700 1 Processor -- start 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.938 7f5cb1dd2700 1 -- start start 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cb1dd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 0x7f5cac10e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cb1dd2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 0x7f5cac0f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cb1dd2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0f1e30 con 0x7f5cac10eee0 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cb1dd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0fb670 con 0x7f5cac106530 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cb1dd2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac106980 con 0x7f5cac10ea90 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cab2b3700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5cac10eee0 0x7f5cac0f1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60232/0 (socket says 172.21.15.73:60232) 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5cab2b3700 1 -- 172.21.15.73:0/2052423133 learned_addr learned my addr 172.21.15.73:0/2052423133 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 0x7f5cac0f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caaab2700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 0x7f5cac10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5ca9ab0700 1 -- 172.21.15.73:0/2052423133 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464028099 0 0) 0x7f5ca4001490 con 0x7f5cac10eee0 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5ca9ab0700 1 -- 172.21.15.73:0/2052423133 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c90003270 con 0x7f5cac10eee0 2024-03-24T10:40:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 -- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 msgr2=0x7f5cac10e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 0x7f5cac10e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 -- 172.21.15.73:0/2052423133 >> v1:172.21.15.73:6789/0 conn(0x7f5cac10eee0 legacy=0x7f5cac0f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 -- 172.21.15.73:0/2052423133 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac1ac7c0 con 0x7f5cac10ea90 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caaab2700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 0x7f5cac10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.939 7f5caa2b1700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 0x7f5cac0f1000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5c9c002f70 tx=0x7f5c9c00b9a0).ready entity=mon.2 client_cookie=5da2eea9713b2024 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5ca9ab0700 1 -- 172.21.15.73:0/2052423133 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5cac1ac7c0 con 0x7f5cac10ea90 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5ca9ab0700 1 -- 172.21.15.73:0/2052423133 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00d570 con 0x7f5cac10ea90 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5ca9ab0700 1 -- 172.21.15.73:0/2052423133 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c9c00d940 con 0x7f5cac10ea90 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 -- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 msgr2=0x7f5cac0f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 0x7f5cac0f1000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5c9c002f70 tx=0x7f5c9c00b9a0).stop 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 -- 172.21.15.73:0/2052423133 shutdown_connections 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac106530 0x7f5cac10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 --2- 172.21.15.73:0/2052423133 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac10ea90 0x7f5cac0f1000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 -- 172.21.15.73:0/2052423133 >> 172.21.15.73:0/2052423133 conn(0x7f5cac114940 msgr2=0x7f5cac114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 -- 172.21.15.73:0/2052423133 shutdown_connections 2024-03-24T10:40:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.940 7f5cb1dd2700 1 -- 172.21.15.73:0/2052423133 wait complete. 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 Processor -- start 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 -- start start 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 0x7f5cac0d6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 0x7f5cac1b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 0x7f5cac1b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c4590 con 0x7f5cac1b4740 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0ddbf0 con 0x7f5cac0d6010 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cb1dd2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0ddf40 con 0x7f5cac0d6a90 2024-03-24T10:40:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5caaab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 0x7f5cac0d6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5caa2b1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 0x7f5cac1b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5caaab2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 0x7f5cac0d6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40100/0 (socket says 172.21.15.73:40100) 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5caaab2700 1 -- 172.21.15.73:0/2913973607 learned_addr learned my addr 172.21.15.73:0/2913973607 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.963 7f5cab2b3700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 0x7f5cac1b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 -- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 msgr2=0x7f5cac0d6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 0x7f5cac0d6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 -- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 msgr2=0x7f5cac1b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 0x7f5cac1b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 -- 172.21.15.73:0/2913973607 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac1bb800 con 0x7f5cac0d6a90 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5cab2b3700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 0x7f5cac1b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5caa2b1700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 0x7f5cac1b4110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5cac0d74a0 tx=0x7f5c9c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5cac1bb800 con 0x7f5cac0d6a90 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0116e0 con 0x7f5cac0d6a90 2024-03-24T10:40:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac1bba00 con 0x7f5cac0d6a90 2024-03-24T10:40:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5c9c022020 con 0x7f5cac0d6a90 2024-03-24T10:40:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac1bbde0 con 0x7f5cac0d6a90 2024-03-24T10:40:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.964 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5c9c011ab0 con 0x7f5cac0d6a90 2024-03-24T10:40:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.965 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5c9c00c800 con 0x7f5cac0d6a90 2024-03-24T10:40:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.965 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac0f08e0 con 0x7f5cac0d6a90 2024-03-24T10:40:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:06.968 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5c9c00d360 con 0x7f5cac0d6a90 2024-03-24T10:40:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.104 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cac1ae810 con 0x7f5cac0d6a90 2024-03-24T10:40:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.105 7f5c9bfff700 1 -- 172.21.15.73:0/2913973607 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7f5c9c0114d0 con 0x7f5cac0d6a90 2024-03-24T10:40:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:07.105 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 >> v1:172.21.15.73:6816/43277 conn(0x7f5c880145b0 legacy=0x7f5c88016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 msgr2=0x7f5cac1b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 0x7f5cac1b4110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5cac0d74a0 tx=0x7f5c9c0068c0).stop 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 shutdown_connections 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cac1b4740 0x7f5cac1b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cac0d6010 0x7f5cac0d6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 --2- 172.21.15.73:0/2913973607 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f5cac0d6a90 0x7f5cac1b4110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 >> 172.21.15.73:0/2913973607 conn(0x7f5cac0e1170 msgr2=0x7f5cac0cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 shutdown_connections 2024-03-24T10:40:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.106 7f5cb1dd2700 1 -- 172.21.15.73:0/2913973607 wait complete. 2024-03-24T10:40:07.107 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:07.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 Processor -- start 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 -- start start 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 0x7f68ac0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 0x7f68ac10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac0f9230 con 0x7f68ac0f2310 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac10f0e0 con 0x7f68ac0f1ec0 2024-03-24T10:40:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b3726700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1ac680 con 0x7f68ac0f5920 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68ab7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 0x7f68ac10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b0d22700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68ac0f2310 0x7f68ac10e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60240/0 (socket says 172.21.15.73:60240) 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68b0d22700 1 -- 172.21.15.73:0/3574663008 learned_addr learned my addr 172.21.15.73:0/3574663008 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68abfff700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 0x7f68ac0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68abfff700 1 -- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 msgr2=0x7f68ac10e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68abfff700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 0x7f68ac10e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68aaffd700 1 -- 172.21.15.73:0/3574663008 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223816138 0 0) 0x7f68a4001490 con 0x7f68ac0f2310 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68abfff700 1 -- 172.21.15.73:0/3574663008 >> v1:172.21.15.73:6789/0 conn(0x7f68ac0f2310 legacy=0x7f68ac10e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68abfff700 1 -- 172.21.15.73:0/3574663008 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac1ac830 con 0x7f68ac0f5920 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.243 7f68ab7fe700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 0x7f68ac10e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68abfff700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 0x7f68ac0f1890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f689c002f70 tx=0x7f689c00b9a0).ready entity=mon.2 client_cookie=38484edfc54429c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68aaffd700 1 -- 172.21.15.73:0/3574663008 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68ac1ac830 con 0x7f68ac0f5920 2024-03-24T10:40:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68aaffd700 1 -- 172.21.15.73:0/3574663008 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c00d5c0 con 0x7f68ac0f5920 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68aaffd700 1 -- 172.21.15.73:0/3574663008 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f689c00d990 con 0x7f68ac0f5920 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 -- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 msgr2=0x7f68ac0f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 0x7f68ac0f1890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f689c002f70 tx=0x7f689c00b9a0).stop 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 -- 172.21.15.73:0/3574663008 shutdown_connections 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0f5920 0x7f68ac0f1890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 --2- 172.21.15.73:0/3574663008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0f1ec0 0x7f68ac10e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 -- 172.21.15.73:0/3574663008 >> 172.21.15.73:0/3574663008 conn(0x7f68ac113a70 msgr2=0x7f68ac0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 -- 172.21.15.73:0/3574663008 shutdown_connections 2024-03-24T10:40:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.244 7f68b3726700 1 -- 172.21.15.73:0/3574663008 wait complete. 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.267 7f68b3726700 1 Processor -- start 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.267 7f68b3726700 1 -- start start 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.267 7f68b3726700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 0x7f68ac0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.267 7f68b3726700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 0x7f68ac1b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0bc2a0 con 0x7f68ac1b4890 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0d44e0 con 0x7f68ac0cee70 2024-03-24T10:40:07.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0d5d20 con 0x7f68ac0ce3f0 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68abfff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 0x7f68ac0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68ab7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 0x7f68ac1b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68abfff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 0x7f68ac0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54824/0 (socket says 172.21.15.73:54824) 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68ab7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40122/0 (socket says 172.21.15.73:40122) 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68abfff700 1 -- 172.21.15.73:0/3980713269 learned_addr learned my addr 172.21.15.73:0/3980713269 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 -- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 msgr2=0x7f68ac0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 0x7f68ac0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 -- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 msgr2=0x7f68ac1b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 -- 172.21.15.73:0/3980713269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0d4d80 con 0x7f68ac1b4890 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68ab7fe700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b0d22700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 0x7f68ac1b4ce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f68ac0dc4f0 tx=0x7f68a400c9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68ac0d4d80 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a4005bb0 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 -- 172.21.15.73:0/3980713269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac1bb950 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68a40070d0 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.268 7f68b3726700 1 -- 172.21.15.73:0/3980713269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac1bbd30 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.269 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f68a40072d0 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.269 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f68a40055a0 con 0x7f68ac1b4890 2024-03-24T10:40:07.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.269 7f68b3726700 1 -- 172.21.15.73:0/3980713269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac0f08e0 con 0x7f68ac1b4890 2024-03-24T10:40:07.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.272 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f68a40059a0 con 0x7f68ac1b4890 2024-03-24T10:40:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.379 7f68b3726700 1 -- 172.21.15.73:0/3980713269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68ac0e2f80 con 0x7f68ac1b4890 2024-03-24T10:40:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.379 7f68a97fa700 1 -- 172.21.15.73:0/3980713269 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f68ac1145f0 con 0x7f68ac1b4890 2024-03-24T10:40:07.380 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:07.380 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:05.778914","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 >> v1:172.21.15.73:6816/43277 conn(0x7f688c0145b0 legacy=0x7f688c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 msgr2=0x7f68ac1b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 0x7f68ac1b4ce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f68ac0dc4f0 tx=0x7f68a400c9e0).stop 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 shutdown_connections 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68ac1b4890 0x7f68ac1b4ce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f68ac0ce3f0 0x7f68ac0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 --2- 172.21.15.73:0/3980713269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68ac0cee70 0x7f68ac1b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 >> 172.21.15.73:0/3980713269 conn(0x7f68ac0c5b00 msgr2=0x7f68ac0bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 shutdown_connections 2024-03-24T10:40:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.381 7f68b3726700 1 -- 172.21.15.73:0/3980713269 wait complete. 2024-03-24T10:40:07.392 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-24T10:40:07.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:07.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 Processor -- start 2024-03-24T10:40:07.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 -- start start 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 0x7fd9980f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.519 7fd99ce9a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9980f9230 con 0x7fd9980f5920 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd99ce9a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99810ef10 con 0x7fd9980f2310 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd99ce9a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981aa660 con 0x7fd9980f1ec0 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd996365700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54830/0 (socket says 172.21.15.73:54830) 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd996365700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40138/0 (socket says 172.21.15.73:40138) 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 -- 172.21.15.73:0/3922409320 learned_addr learned my addr 172.21.15.73:0/3922409320 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995b64700 1 --2- 172.21.15.73:0/3922409320 >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 0x7fd9980f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 -- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 msgr2=0x7fd99810e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 -- 172.21.15.73:0/3922409320 >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 msgr2=0x7fd9980f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 --2- 172.21.15.73:0/3922409320 >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 0x7fd9980f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 -- 172.21.15.73:0/3922409320 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9981aa810 con 0x7fd9980f1ec0 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd996365700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995b64700 1 --2- 172.21.15.73:0/3922409320 >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 0x7fd9980f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd995363700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd980002f70 tx=0x7fd9800099d0).ready entity=mon.2 client_cookie=dcc98d78f5ab42f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd994b62700 1 -- 172.21.15.73:0/3922409320 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9981aa810 con 0x7fd9980f1ec0 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd994b62700 1 -- 172.21.15.73:0/3922409320 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000f510 con 0x7fd9980f1ec0 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd994b62700 1 -- 172.21.15.73:0/3922409320 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd98000f6f0 con 0x7fd9980f1ec0 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd99ce9a700 1 -- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 msgr2=0x7fd99810e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.520 7fd99ce9a700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd980002f70 tx=0x7fd9800099d0).stop 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 -- 172.21.15.73:0/3922409320 shutdown_connections 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980f2310 0x7fd99810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 --2- 172.21.15.73:0/3922409320 >> v2:172.21.15.73:3300/0 conn(0x7fd9980f5920 0x7fd9980f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 --2- 172.21.15.73:0/3922409320 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980f1ec0 0x7fd99810e2b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 -- 172.21.15.73:0/3922409320 >> 172.21.15.73:0/3922409320 conn(0x7fd998113a70 msgr2=0x7fd9980f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 -- 172.21.15.73:0/3922409320 shutdown_connections 2024-03-24T10:40:07.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.521 7fd99ce9a700 1 -- 172.21.15.73:0/3922409320 wait complete. 2024-03-24T10:40:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 Processor -- start 2024-03-24T10:40:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 -- start start 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 0x7fd9981b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 0x7fd9981b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980da9d0 con 0x7fd9981b4e70 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980d14d0 con 0x7fd9980d6f70 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd99ce9a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981b58f0 con 0x7fd9980d1080 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd995b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd995363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 0x7fd9981b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd995b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40144/0 (socket says 172.21.15.73:40144) 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd995363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 0x7fd9981b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54844/0 (socket says 172.21.15.73:54844) 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd995b64700 1 -- 172.21.15.73:0/2092848686 learned_addr learned my addr 172.21.15.73:0/2092848686 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.544 7fd996365700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 0x7fd9981b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 -- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 msgr2=0x7fd9981b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 0x7fd9981b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 -- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 msgr2=0x7fd9981b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 0x7fd9981b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 -- 172.21.15.73:0/2092848686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980d73c0 con 0x7fd9980d6f70 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd996365700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 0x7fd9981b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd995b64700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd9980dbd70 tx=0x7fd99000c430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9980d73c0 con 0x7fd9980d6f70 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99000c9c0 con 0x7fd9980d6f70 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9981bbd20 con 0x7fd9980d6f70 2024-03-24T10:40:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd99000f040 con 0x7fd9980d6f70 2024-03-24T10:40:07.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9981bc100 con 0x7fd9980d6f70 2024-03-24T10:40:07.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd990022060 con 0x7fd9980d6f70 2024-03-24T10:40:07.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.545 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd990010040 con 0x7fd9980d6f70 2024-03-24T10:40:07.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.546 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9980f08e0 con 0x7fd9980d6f70 2024-03-24T10:40:07.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.549 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd99000edd0 con 0x7fd9980d6f70 2024-03-24T10:40:07.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.651 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fd998087810 con 0x7fd97c0145b0 2024-03-24T10:40:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.659 7fd98effd700 1 -- 172.21.15.73:0/2092848686 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300749 (unknown 2965378022 0 365961005) 0x7fd980009240 con 0x7fd97c0145b0 2024-03-24T10:40:07.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 >> v1:172.21.15.73:6816/43277 conn(0x7fd97c0145b0 legacy=0x7fd97c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 msgr2=0x7fd9980d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd9980dbd70 tx=0x7fd99000c430).stop 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 shutdown_connections 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9981b4e70 0x7fd9981b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9980d6f70 0x7fd9980d0a50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 --2- 172.21.15.73:0/2092848686 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd9980d1080 0x7fd9981b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 >> 172.21.15.73:0/2092848686 conn(0x7fd9980c5c90 msgr2=0x7fd9980e0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 shutdown_connections 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.661 7fd99ce9a700 1 -- 172.21.15.73:0/2092848686 wait complete. 2024-03-24T10:40:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:07.672 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-03-24 10:40:07.120973","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195096,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292264,"statfs":{"total":386547056640,"available":382251278336,"internally_reserved":4294967296,"allocated":778240,"data_stored":230582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3463,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.102106"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433217","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435957","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439857","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440147","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439875","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437564","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437813","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439715","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440170","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437323","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437204","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434487","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435372","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436705","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440439","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439822","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443681","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433996","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.442034","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436495","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439215","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435839","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439322","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438291","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436506","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436364","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433350","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438491","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435504","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436414","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435706","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443264","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435969","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434130","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435024","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433626","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435064","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433596","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435362","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438874","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435563","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433338","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434614","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441380","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434190","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434277","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437923","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435611","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435050","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440511","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439534","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433118","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436429","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433876","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433329","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240307","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:59.240307","last_peered":"2024-03-24 10:39:59.240307","last_clean":"2024-03-24 10:39:59.240307","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:59.240307","last_undegraded":"2024-03-24 10:39:59.240307","last_fullsized":"2024-03-24 10:39:59.240307","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436300","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240135","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:59.240135","last_peered":"2024-03-24 10:39:59.240135","last_clean":"2024-03-24 10:39:59.240135","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:59.240135","last_undegraded":"2024-03-24 10:39:59.240135","last_fullsized":"2024-03-24 10:39:59.240135","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438497","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044789","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:00.044789","last_peered":"2024-03-24 10:40:00.044789","last_clean":"2024-03-24 10:40:00.044789","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:00.044789","last_undegraded":"2024-03-24 10:40:00.044789","last_fullsized":"2024-03-24 10:40:00.044789","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437554","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.930560","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:00.930560","last_peered":"2024-03-24 10:40:00.930560","last_clean":"2024-03-24 10:40:00.930560","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:00.930560","last_undegraded":"2024-03-24 10:40:00.930560","last_fullsized":"2024-03-24 10:40:00.930560","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434646","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044784","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:00.044784","last_peered":"2024-03-24 10:40:00.044784","last_clean":"2024-03-24 10:40:00.044784","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:00.044784","last_undegraded":"2024-03-24 10:40:00.044784","last_fullsized":"2024-03-24 10:40:00.044784","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441325","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240185","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:59.240185","last_peered":"2024-03-24 10:39:59.240185","last_clean":"2024-03-24 10:39:59.240185","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:59.240185","last_undegraded":"2024-03-24 10:39:59.240185","last_fullsized":"2024-03-24 10:39:59.240185","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439224","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240230","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:59.240230","last_peered":"2024-03-24 10:39:59.240230","last_clean":"2024-03-24 10:39:59.240230","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:59.240230","last_undegraded":"2024-03-24 10:39:59.240230","last_fullsized":"2024-03-24 10:39:59.240230","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441010","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044781","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:00.044781","last_peered":"2024-03-24 10:40:00.044781","last_clean":"2024-03-24 10:40:00.044781","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:00.044781","last_undegraded":"2024-03-24 10:40:00.044781","last_fullsized":"2024-03-24 10:40:00.044781","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}]}} 2024-03-24T10:40:07.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 Processor -- start 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 -- start start 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 0x7f47c80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c80f9230 con 0x7f47c80f5920 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c810ef10 con 0x7f47c80f2310 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.841 7f47cfeb3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81aa660 con 0x7f47c80f1ec0 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cd4af700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cccae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 0x7f47c80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54858/0 (socket says 172.21.15.73:54858) 2024-03-24T10:40:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cccae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 0x7f47c80f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39026/0 (socket says 172.21.15.73:39026) 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cd4af700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40154/0 (socket says 172.21.15.73:40154) 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 -- 172.21.15.73:0/1917103960 learned_addr learned my addr 172.21.15.73:0/1917103960 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 -- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 msgr2=0x7f47c810e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 -- 172.21.15.73:0/1917103960 >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 msgr2=0x7f47c80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 --2- 172.21.15.73:0/1917103960 >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 0x7f47c80f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 -- 172.21.15.73:0/1917103960 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c81aa810 con 0x7f47c80f1ec0 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cd4af700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c7fff700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f47b4002f70 tx=0x7f47b40099d0).ready entity=mon.2 client_cookie=49bcaa1adb964f0a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c77fe700 1 -- 172.21.15.73:0/1917103960 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47c81aa810 con 0x7f47c80f1ec0 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c77fe700 1 -- 172.21.15.73:0/1917103960 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400f510 con 0x7f47c80f1ec0 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47c77fe700 1 -- 172.21.15.73:0/1917103960 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47b400f6f0 con 0x7f47c80f1ec0 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cfeb3700 1 -- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 msgr2=0x7f47c810e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.842 7f47cfeb3700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f47b4002f70 tx=0x7f47b40099d0).stop 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 -- 172.21.15.73:0/1917103960 shutdown_connections 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80f2310 0x7f47c810e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 --2- 172.21.15.73:0/1917103960 >> v2:172.21.15.73:3300/0 conn(0x7f47c80f5920 0x7f47c80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 --2- 172.21.15.73:0/1917103960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c80f1ec0 0x7f47c810e2b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 -- 172.21.15.73:0/1917103960 >> 172.21.15.73:0/1917103960 conn(0x7f47c8113a70 msgr2=0x7f47c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 -- 172.21.15.73:0/1917103960 shutdown_connections 2024-03-24T10:40:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.843 7f47cfeb3700 1 -- 172.21.15.73:0/1917103960 wait complete. 2024-03-24T10:40:07.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.866 7f47cfeb3700 1 Processor -- start 2024-03-24T10:40:07.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.866 7f47cfeb3700 1 -- start start 2024-03-24T10:40:07.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 0x7f47c81b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 0x7f47c81b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80da9d0 con 0x7f47c80d6f70 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80d14d0 con 0x7f47c80d1080 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81b58f0 con 0x7f47c81b4e70 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47c7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 0x7f47c81b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39036/0 (socket says 172.21.15.73:39036) 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 -- 172.21.15.73:0/2384475920 learned_addr learned my addr 172.21.15.73:0/2384475920 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cd4af700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 0x7f47c81b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 -- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 msgr2=0x7f47c81b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 0x7f47c81b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 -- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 msgr2=0x7f47c81b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 0x7f47c81b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 -- 172.21.15.73:0/2384475920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80d73c0 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cd4af700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 0x7f47c81b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47c7fff700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 0x7f47c81b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cccae700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f47c80bfc10 tx=0x7f47bc00ebf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47c80d73c0 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00ee60 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c81bbd20 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47bc00f040 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.867 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c81bc100 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.868 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f47bc011070 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.868 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f47bc010040 con 0x7f47c80d6f70 2024-03-24T10:40:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.868 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c80f08e0 con 0x7f47c80d6f70 2024-03-24T10:40:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.872 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f47bc00c5a0 con 0x7f47c80d6f70 2024-03-24T10:40:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.972 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f47c8087810 con 0x7f47b00145b0 2024-03-24T10:40:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.980 7f47c5ffb700 1 -- 172.21.15.73:0/2384475920 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300749 (unknown 2965378022 0 365961005) 0x7f47b4009240 con 0x7f47b00145b0 2024-03-24T10:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 >> v1:172.21.15.73:6816/43277 conn(0x7f47b00145b0 legacy=0x7f47b0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 msgr2=0x7f47c80d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f47c80bfc10 tx=0x7f47bc00ebf0).stop 2024-03-24T10:40:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 shutdown_connections 2024-03-24T10:40:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f47c81b4e70 0x7f47c81b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c80d6f70 0x7f47c80d0a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 --2- 172.21.15.73:0/2384475920 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47c80d1080 0x7f47c81b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 >> 172.21.15.73:0/2384475920 conn(0x7f47c80c5c90 msgr2=0x7f47c80e0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 shutdown_connections 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:07.982 7f47cfeb3700 1 -- 172.21.15.73:0/2384475920 wait complete. 2024-03-24T10:40:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-03-24 10:40:07.120973","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195096,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292264,"statfs":{"total":386547056640,"available":382251278336,"internally_reserved":4294967296,"allocated":778240,"data_stored":230582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3463,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.102106"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433217","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435957","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439857","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440147","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439875","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437564","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437813","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439715","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440170","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437323","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437204","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434487","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435372","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436705","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440439","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439822","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443681","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433996","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.442034","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436495","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439215","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435839","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439322","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438291","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436506","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436364","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433350","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438491","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435504","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436414","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435706","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443264","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435969","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434130","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435024","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433626","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435064","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433596","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435362","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438874","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435563","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433338","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434614","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441380","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434190","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434277","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437923","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435611","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435050","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440511","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439534","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433118","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436429","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433876","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433329","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240307","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:59.240307","last_peered":"2024-03-24 10:39:59.240307","last_clean":"2024-03-24 10:39:59.240307","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:59.240307","last_undegraded":"2024-03-24 10:39:59.240307","last_fullsized":"2024-03-24 10:39:59.240307","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436300","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240135","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:59.240135","last_peered":"2024-03-24 10:39:59.240135","last_clean":"2024-03-24 10:39:59.240135","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:59.240135","last_undegraded":"2024-03-24 10:39:59.240135","last_fullsized":"2024-03-24 10:39:59.240135","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438497","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044789","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:00.044789","last_peered":"2024-03-24 10:40:00.044789","last_clean":"2024-03-24 10:40:00.044789","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:00.044789","last_undegraded":"2024-03-24 10:40:00.044789","last_fullsized":"2024-03-24 10:40:00.044789","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437554","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.930560","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:00.930560","last_peered":"2024-03-24 10:40:00.930560","last_clean":"2024-03-24 10:40:00.930560","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:00.930560","last_undegraded":"2024-03-24 10:40:00.930560","last_fullsized":"2024-03-24 10:40:00.930560","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434646","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044784","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:00.044784","last_peered":"2024-03-24 10:40:00.044784","last_clean":"2024-03-24 10:40:00.044784","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:00.044784","last_undegraded":"2024-03-24 10:40:00.044784","last_fullsized":"2024-03-24 10:40:00.044784","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441325","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240185","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:59.240185","last_peered":"2024-03-24 10:39:59.240185","last_clean":"2024-03-24 10:39:59.240185","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:59.240185","last_undegraded":"2024-03-24 10:39:59.240185","last_fullsized":"2024-03-24 10:39:59.240185","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439224","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240230","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:59.240230","last_peered":"2024-03-24 10:39:59.240230","last_clean":"2024-03-24 10:39:59.240230","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:59.240230","last_undegraded":"2024-03-24 10:39:59.240230","last_fullsized":"2024-03-24 10:39:59.240230","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441010","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044781","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:00.044781","last_peered":"2024-03-24 10:40:00.044781","last_clean":"2024-03-24 10:40:00.044781","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:00.044781","last_undegraded":"2024-03-24 10:40:00.044781","last_fullsized":"2024-03-24 10:40:00.044781","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}]}} 2024-03-24T10:40:07.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:08.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 Processor -- start 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 -- start start 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85300f5920 0x7f853010c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f853010c970 0x7f85300f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300f26c0 con 0x7f853010cdc0 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300fa290 con 0x7f853010c970 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8537673700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300f95c0 con 0x7f85300f5920 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f852ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85300f5920 0x7f853010c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f852f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f853010c970 0x7f85300f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8534c6f700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f853010cdc0 0x7f85300f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60254/0 (socket says 172.21.15.73:60254) 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.160 7f8534c6f700 1 -- 172.21.15.73:0/2647629596 learned_addr learned my addr 172.21.15.73:0/2647629596 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852f7fe700 1 -- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85300f5920 msgr2=0x7f853010c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852f7fe700 1 --2- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85300f5920 0x7f853010c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852f7fe700 1 -- 172.21.15.73:0/2647629596 >> v1:172.21.15.73:6789/0 conn(0x7f853010cdc0 legacy=0x7f85300f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852effd700 1 -- 172.21.15.73:0/2647629596 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752305372 0 0) 0x7f8528001490 con 0x7f853010cdc0 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852f7fe700 1 -- 172.21.15.73:0/2647629596 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85301aa5e0 con 0x7f853010c970 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852f7fe700 1 --2- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853010c970 0x7f85300f1890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8530113400 tx=0x7f852000ba20).ready entity=mon.0 client_cookie=6c40b639e7f6120d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852effd700 1 -- 172.21.15.73:0/2647629596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85301aa5e0 con 0x7f853010c970 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852effd700 1 -- 172.21.15.73:0/2647629596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000d5c0 con 0x7f853010c970 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f852effd700 1 -- 172.21.15.73:0/2647629596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f852000d990 con 0x7f853010c970 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f8537673700 1 -- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853010c970 msgr2=0x7f85300f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.161 7f8537673700 1 --2- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853010c970 0x7f85300f1890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8530113400 tx=0x7f852000ba20).stop 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 -- 172.21.15.73:0/2647629596 shutdown_connections 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 --2- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85300f5920 0x7f853010c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 --2- 172.21.15.73:0/2647629596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853010c970 0x7f85300f1890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 -- 172.21.15.73:0/2647629596 >> 172.21.15.73:0/2647629596 conn(0x7f8530113a70 msgr2=0x7f85300f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 -- 172.21.15.73:0/2647629596 shutdown_connections 2024-03-24T10:40:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.162 7f8537673700 1 -- 172.21.15.73:0/2647629596 wait complete. 2024-03-24T10:40:08.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.184 7f8537673700 1 Processor -- start 2024-03-24T10:40:08.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.184 7f8537673700 1 -- start start 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85300d5f40 0x7f85301b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85301b2b00 0x7f85301b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300f0250 con 0x7f85300d5f40 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85301b3580 con 0x7f85301b2b00 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85301a5e30 con 0x7f85300d54c0 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85300d5f40 0x7f85301b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8534c6f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85301b2b00 0x7f85301b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54866/0 (socket says 172.21.15.73:54866) 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 -- 172.21.15.73:0/1442829179 learned_addr learned my addr 172.21.15.73:0/1442829179 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 -- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85301b2b00 msgr2=0x7f85301b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85301b2b00 0x7f85301b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 -- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85300d5f40 msgr2=0x7f85301b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85300d5f40 0x7f85301b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 -- 172.21.15.73:0/1442829179 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300e0510 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852ffff700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f85300d78b0 tx=0x7f851800ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85300e0510 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851800ca20 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f851800f040 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.185 7f8537673700 1 -- 172.21.15.73:0/1442829179 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300c4690 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.186 7f8537673700 1 -- 172.21.15.73:0/1442829179 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301b9da0 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.186 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8518011070 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.186 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8518010040 con 0x7f85300d54c0 2024-03-24T10:40:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.186 7f8537673700 1 -- 172.21.15.73:0/1442829179 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300f08e0 con 0x7f85300d54c0 2024-03-24T10:40:08.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.190 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f851800c620 con 0x7f85300d54c0 2024-03-24T10:40:08.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.290 7f8537673700 1 -- 172.21.15.73:0/1442829179 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f8530087810 con 0x7f85140145b0 2024-03-24T10:40:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.297 7f852d7fa700 1 -- 172.21.15.73:0/1442829179 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300749 (unknown 2965378022 0 365961005) 0x7f852000b130 con 0x7f85140145b0 2024-03-24T10:40:08.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 >> v1:172.21.15.73:6816/43277 conn(0x7f85140145b0 legacy=0x7f8514016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 msgr2=0x7f85300d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f85300d78b0 tx=0x7f851800ec80).stop 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 shutdown_connections 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85301b2b00 0x7f85301b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f85300d54c0 0x7f85300d5910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 --2- 172.21.15.73:0/1442829179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85300d5f40 0x7f85301b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 >> 172.21.15.73:0/1442829179 conn(0x7f85300c91d0 msgr2=0x7f85300c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 shutdown_connections 2024-03-24T10:40:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.300 7f8537673700 1 -- 172.21.15.73:0/1442829179 wait complete. 2024-03-24T10:40:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:08.311 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-03-24 10:40:07.120973","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195096,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292264,"statfs":{"total":386547056640,"available":382251278336,"internally_reserved":4294967296,"allocated":778240,"data_stored":230582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3463,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.102106"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433217","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435957","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439857","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440147","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439875","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437564","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437813","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439715","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440170","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437323","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437204","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434487","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435372","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436705","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440439","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439822","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443681","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433996","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.442034","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436495","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439215","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435839","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439322","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438291","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436506","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436364","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433350","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438491","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435504","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436414","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435706","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443264","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435969","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434130","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435024","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433626","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435064","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433596","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435362","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438874","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435563","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433338","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434614","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441380","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434190","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434277","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437923","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435611","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435050","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440511","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439534","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433118","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436429","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433876","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433329","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240307","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:59.240307","last_peered":"2024-03-24 10:39:59.240307","last_clean":"2024-03-24 10:39:59.240307","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:59.240307","last_undegraded":"2024-03-24 10:39:59.240307","last_fullsized":"2024-03-24 10:39:59.240307","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436300","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240135","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:59.240135","last_peered":"2024-03-24 10:39:59.240135","last_clean":"2024-03-24 10:39:59.240135","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:59.240135","last_undegraded":"2024-03-24 10:39:59.240135","last_fullsized":"2024-03-24 10:39:59.240135","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438497","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044789","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:00.044789","last_peered":"2024-03-24 10:40:00.044789","last_clean":"2024-03-24 10:40:00.044789","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:00.044789","last_undegraded":"2024-03-24 10:40:00.044789","last_fullsized":"2024-03-24 10:40:00.044789","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437554","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.930560","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:00.930560","last_peered":"2024-03-24 10:40:00.930560","last_clean":"2024-03-24 10:40:00.930560","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:00.930560","last_undegraded":"2024-03-24 10:40:00.930560","last_fullsized":"2024-03-24 10:40:00.930560","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434646","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044784","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:00.044784","last_peered":"2024-03-24 10:40:00.044784","last_clean":"2024-03-24 10:40:00.044784","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:00.044784","last_undegraded":"2024-03-24 10:40:00.044784","last_fullsized":"2024-03-24 10:40:00.044784","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441325","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240185","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:59.240185","last_peered":"2024-03-24 10:39:59.240185","last_clean":"2024-03-24 10:39:59.240185","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:59.240185","last_undegraded":"2024-03-24 10:39:59.240185","last_fullsized":"2024-03-24 10:39:59.240185","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439224","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240230","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:59.240230","last_peered":"2024-03-24 10:39:59.240230","last_clean":"2024-03-24 10:39:59.240230","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:59.240230","last_undegraded":"2024-03-24 10:39:59.240230","last_fullsized":"2024-03-24 10:39:59.240230","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441010","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044781","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:00.044781","last_peered":"2024-03-24 10:40:00.044781","last_clean":"2024-03-24 10:40:00.044781","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:00.044781","last_undegraded":"2024-03-24 10:40:00.044781","last_fullsized":"2024-03-24 10:40:00.044781","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}]}} 2024-03-24T10:40:08.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-24T10:40:08.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-03-24T10:40:08.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433217', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435957', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439857', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-03-24T10:40:08.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.440147', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439875', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437564', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-03-24T10:40:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437813', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439715', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.440170', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-24T10:40:08.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437323', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437204', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434487', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-24T10:40:08.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435372', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436705', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.440439', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-24T10:40:08.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434711', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439822', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.443681', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-03-24T10:40:08.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433996', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.442034', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436495', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-03-24T10:40:08.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439215', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435839', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439322', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.438291', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436506', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436364', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.441711', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433350', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.438491', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-03-24T10:40:08.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435504', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436414', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435706', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-24T10:40:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.443264', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435969', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434130', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-03-24T10:40:08.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435024', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433626', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435064', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433596', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435362', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.438874', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435563', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-24T10:40:08.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433338', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434614', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.441380', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434190', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434277', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437923', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-03-24T10:40:08.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435611', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.435050', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.440511', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439534', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433118', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436429', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433876', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-24T10:40:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.433329', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.436300', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.438497', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-24T10:40:08.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.437554', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.434646', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.441325', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.439224', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-03-24 10:40:04.429389', 'last_change': '2024-03-24 10:40:04.429389', 'last_active': '2024-03-24 10:40:04.429389', 'last_peered': '2024-03-24 10:40:04.429389', 'last_clean': '2024-03-24 10:40:04.429389', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:04.429389', 'last_undegraded': '2024-03-24 10:40:04.429389', 'last_fullsized': '2024-03-24 10:40:04.429389', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:04.429389', 'last_clean_scrub_stamp': '2024-03-24 10:40:04.429389', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-03-24T10:40:08.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'creating+peering', 'last_fresh': '2024-03-24 10:40:03.425851', 'last_change': '2024-03-24 10:40:03.441010', 'last_active': '2024-03-24 10:40:03.425851', 'last_peered': '2024-03-24 10:40:03.425851', 'last_clean': '2024-03-24 10:40:03.425851', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24 10:40:03.425851', 'last_undegraded': '2024-03-24 10:40:03.425851', 'last_fullsized': '2024-03-24 10:40:03.425851', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24 10:40:03.425851', 'last_clean_scrub_stamp': '2024-03-24 10:40:03.425851', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:40:08.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.475 7fe29d9a8700 1 Processor -- start 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.475 7fe29d9a8700 1 -- start start 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe29810c970 0x7fe2980f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980fa290 con 0x7fe29810c970 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980f95c0 con 0x7fe29810cdc0 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe29d9a8700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980f24f0 con 0x7fe2980f5920 2024-03-24T10:40:08.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe296dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2965c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe29810c970 0x7fe2980f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2965c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54878/0 (socket says 172.21.15.73:54878) 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe296dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40196/0 (socket says 172.21.15.73:40196) 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2965c5700 1 -- 172.21.15.73:0/3483790642 learned_addr learned my addr 172.21.15.73:0/3483790642 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 -- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 msgr2=0x7fe29810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 -- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 msgr2=0x7fe2980f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 -- 172.21.15.73:0/3483790642 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980f2720 con 0x7fe29810c970 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe296dc6700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2965c5700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe295dc4700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29810c970 0x7fe2980f1890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe2980f9770 tx=0x7fe28c00ba20).ready entity=mon.0 client_cookie=ce0f0ec444ebf482 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2955c3700 1 -- 172.21.15.73:0/3483790642 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2980f2720 con 0x7fe29810c970 2024-03-24T10:40:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.476 7fe2955c3700 1 -- 172.21.15.73:0/3483790642 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00d570 con 0x7fe29810c970 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe2955c3700 1 -- 172.21.15.73:0/3483790642 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe28c00d940 con 0x7fe29810c970 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 -- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29810c970 msgr2=0x7fe2980f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29810c970 0x7fe2980f1890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe2980f9770 tx=0x7fe28c00ba20).stop 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 -- 172.21.15.73:0/3483790642 shutdown_connections 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe29810cdc0 0x7fe2980f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2980f5920 0x7fe29810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 --2- 172.21.15.73:0/3483790642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe29810c970 0x7fe2980f1890 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 -- 172.21.15.73:0/3483790642 >> 172.21.15.73:0/3483790642 conn(0x7fe298113a70 msgr2=0x7fe2980f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 -- 172.21.15.73:0/3483790642 shutdown_connections 2024-03-24T10:40:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.477 7fe29d9a8700 1 -- 172.21.15.73:0/3483790642 wait complete. 2024-03-24T10:40:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 Processor -- start 2024-03-24T10:40:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 -- start start 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2981a8de0 0x7fe2981b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 0x7fe2981b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980f7970 con 0x7fe2981b46a0 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980d8cb0 con 0x7fe2981a8de0 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe29d9a8700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980d06e0 con 0x7fe2981a8360 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe2965c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe296dc6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 0x7fe2981b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe2965c5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:54884/0 (socket says 172.21.15.73:54884) 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe295dc4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2981a8de0 0x7fe2981b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe296dc6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 0x7fe2981b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39078/0 (socket says 172.21.15.73:39078) 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.500 7fe2965c5700 1 -- 172.21.15.73:0/422609994 learned_addr learned my addr 172.21.15.73:0/422609994 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 -- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2981a8de0 msgr2=0x7fe2981b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2981a8de0 0x7fe2981b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 -- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 msgr2=0x7fe2981b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 0x7fe2981b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 -- 172.21.15.73:0/422609994 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980dff90 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2965c5700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe2980e03b0 tx=0x7fe28800ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2980dff90 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800c620 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2981bb760 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe28800f040 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2981bbb40 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe288022060 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.501 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe288010040 con 0x7fe2981a8360 2024-03-24T10:40:08.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.502 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2980de030 con 0x7fe2981a8360 2024-03-24T10:40:08.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.505 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe28800edf0 con 0x7fe2981a8360 2024-03-24T10:40:08.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.642 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe2980f08e0 con 0x7fe2981a8360 2024-03-24T10:40:08.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.643 7fe2877fe700 1 -- 172.21.15.73:0/422609994 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+33651 (secure 0 0 0) 0x7fe288000c30 con 0x7fe2981a8360 2024-03-24T10:40:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:08.644 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","health":{"checks":{},"status":"HEALTH_OK"},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":66,"monmap":{"epoch":1,"min_mon_release_name":"14","num_mons":3},"osdmap":{"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"num_in_osds":4,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":8}],"num_pgs":136,"num_pools":3,"num_objects":0,"data_bytes":0,"bytes_used":4295778304,"bytes_avail":382251278336,"bytes_total":386547056640,"unknown_pgs_ratio":0.47058823704719543,"inactive_pgs_ratio":0.47058823704719543},"fsmap":{"epoch":11,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4980}],"up:standby":0},"mgrmap":{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6816","nonce":43277}]},"active_addr":"172.21.15.73:6816/43277","active_change":"2024-03-24 10:39:05.106700","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}},"servicemap":{"epoch":3,"modified":"2024-03-24 10:40:07.121024","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 >> v1:172.21.15.73:6816/43277 conn(0x7fe2740145b0 legacy=0x7fe274016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 msgr2=0x7fe2981a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe2980e03b0 tx=0x7fe28800ecb0).stop 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 shutdown_connections 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2981b46a0 0x7fe2981b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe2981a8360 0x7fe2981a87b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 --2- 172.21.15.73:0/422609994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe2981a8de0 0x7fe2981b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 >> 172.21.15.73:0/422609994 conn(0x7fe2980c55b0 msgr2=0x7fe2980f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 shutdown_connections 2024-03-24T10:40:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.645 7fe29d9a8700 1 -- 172.21.15.73:0/422609994 wait complete. 2024-03-24T10:40:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-24T10:40:08.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.781 7fe1a0a66700 1 Processor -- start 2024-03-24T10:40:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 -- start start 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe19c19fdc0 0x7fe19c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c0f97c0 con 0x7fe19c1a0840 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c103d10 con 0x7fe19c19fdc0 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe1a0a66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c103f40 con 0x7fe19c1038c0 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe19a051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe199850700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe19c19fdc0 0x7fe19c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe19a051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40214/0 (socket says 172.21.15.73:40214) 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe19a051700 1 -- 172.21.15.73:0/2552293332 learned_addr learned my addr 172.21.15.73:0/2552293332 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.782 7fe19904f700 1 --1- 172.21.15.73:0/2552293332 >> v1:172.21.15.73:6789/0 conn(0x7fe19c1a0840 0x7fe19c1030c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60260/0 (socket says 172.21.15.73:60260) 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19a051700 1 -- 172.21.15.73:0/2552293332 >> v2:172.21.15.73:3300/0 conn(0x7fe19c19fdc0 msgr2=0x7fe19c1a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19a051700 1 --2- 172.21.15.73:0/2552293332 >> v2:172.21.15.73:3300/0 conn(0x7fe19c19fdc0 0x7fe19c1a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19a051700 1 -- 172.21.15.73:0/2552293332 >> v1:172.21.15.73:6789/0 conn(0x7fe19c1a0840 legacy=0x7fe19c1030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19a051700 1 -- 172.21.15.73:0/2552293332 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c1acd00 con 0x7fe19c1038c0 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19a051700 1 --2- 172.21.15.73:0/2552293332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe1940032f0 tx=0x7fe194009d60).ready entity=mon.1 client_cookie=a09b35b8595d611e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19884e700 1 -- 172.21.15.73:0/2552293332 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe19c1acd00 con 0x7fe19c1038c0 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19884e700 1 -- 172.21.15.73:0/2552293332 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19400b880 con 0x7fe19c1038c0 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe19884e700 1 -- 172.21.15.73:0/2552293332 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe19400ba60 con 0x7fe19c1038c0 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe1a0a66700 1 -- 172.21.15.73:0/2552293332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 msgr2=0x7fe19c1ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.783 7fe1a0a66700 1 --2- 172.21.15.73:0/2552293332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe1940032f0 tx=0x7fe194009d60).stop 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 -- 172.21.15.73:0/2552293332 shutdown_connections 2024-03-24T10:40:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 --2- 172.21.15.73:0/2552293332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c1038c0 0x7fe19c1ab6c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 --2- 172.21.15.73:0/2552293332 >> v2:172.21.15.73:3300/0 conn(0x7fe19c19fdc0 0x7fe19c1a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 -- 172.21.15.73:0/2552293332 >> 172.21.15.73:0/2552293332 conn(0x7fe19c112fe0 msgr2=0x7fe19c113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 -- 172.21.15.73:0/2552293332 shutdown_connections 2024-03-24T10:40:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.784 7fe1a0a66700 1 -- 172.21.15.73:0/2552293332 wait complete. 2024-03-24T10:40:08.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.807 7fe1a0a66700 1 Processor -- start 2024-03-24T10:40:08.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.807 7fe1a0a66700 1 -- start start 2024-03-24T10:40:08.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe19c0d5a10 0x7fe19c1b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 0x7fe19c1b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0daff0 con 0x7fe19c0d5e60 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1b5120 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe1a0a66700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1b5350 con 0x7fe19c0d5a10 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe19904f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe19c0d5a10 0x7fe19c1b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:40222/0 (socket says 172.21.15.73:40222) 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 -- 172.21.15.73:0/1945709722 learned_addr learned my addr 172.21.15.73:0/1945709722 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe19a051700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 0x7fe19c1b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 -- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe19c0d5a10 msgr2=0x7fe19c1b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe19c0d5a10 0x7fe19c1b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 -- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 msgr2=0x7fe19c1b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 0x7fe19c1b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 -- 172.21.15.73:0/1945709722 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c1bbc30 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe19a051700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 0x7fe19c1b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe199850700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe19c0c52e0 tx=0x7fe18c00ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe19c1bbc30 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.808 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c00c9a0 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.809 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c1bbe30 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.809 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe18c00f040 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.809 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c1bc210 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.809 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe18c011070 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.809 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe18c010040 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.810 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c0f08e0 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.813 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe18c00c5a0 con 0x7fe19c0cc5a0 2024-03-24T10:40:08.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.916 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fe19c087810 con 0x7fe1780145b0 2024-03-24T10:40:08.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.923 7fe18affd700 1 -- 172.21.15.73:0/1945709722 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300749 (unknown 2965378022 0 365961005) 0x7fe1900011c0 con 0x7fe1780145b0 2024-03-24T10:40:08.927 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 >> v1:172.21.15.73:6816/43277 conn(0x7fe1780145b0 legacy=0x7fe178016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 msgr2=0x7fe19c0d53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe19c0c52e0 tx=0x7fe18c00ecd0).stop 2024-03-24T10:40:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 shutdown_connections 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe19c0d5e60 0x7fe19c1b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe19c0cc5a0 0x7fe19c0d53e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 --2- 172.21.15.73:0/1945709722 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe19c0d5a10 0x7fe19c1b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 >> 172.21.15.73:0/1945709722 conn(0x7fe19c0c5830 msgr2=0x7fe19c0d64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 shutdown_connections 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:08.926 7fe1a0a66700 1 -- 172.21.15.73:0/1945709722 wait complete. 2024-03-24T10:40:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:08.936 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-03-24 10:40:07.120973","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195096,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292264,"statfs":{"total":386547056640,"available":382251278336,"internally_reserved":4294967296,"allocated":778240,"data_stored":230582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3463,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.102106"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433217","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435957","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439857","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440147","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439875","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437564","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437813","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439715","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440170","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437323","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437204","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434487","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435372","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436705","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440439","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439822","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443681","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433996","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.442034","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436495","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439215","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435839","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439322","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438291","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436506","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436364","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441711","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433350","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438491","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435504","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436414","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435706","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.443264","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435969","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434130","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435024","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433626","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435064","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433596","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435362","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438874","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435563","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433338","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434614","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441380","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434190","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434277","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437923","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435611","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.435050","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.440511","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439534","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433118","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436429","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433876","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.433329","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240307","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:39:59.240307","last_peered":"2024-03-24 10:39:59.240307","last_clean":"2024-03-24 10:39:59.240307","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:39:59.240307","last_undegraded":"2024-03-24 10:39:59.240307","last_fullsized":"2024-03-24 10:39:59.240307","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.436300","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240135","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:39:59.240135","last_peered":"2024-03-24 10:39:59.240135","last_clean":"2024-03-24 10:39:59.240135","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:39:59.240135","last_undegraded":"2024-03-24 10:39:59.240135","last_fullsized":"2024-03-24 10:39:59.240135","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.438497","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044789","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:00.044789","last_peered":"2024-03-24 10:40:00.044789","last_clean":"2024-03-24 10:40:00.044789","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:00.044789","last_undegraded":"2024-03-24 10:40:00.044789","last_fullsized":"2024-03-24 10:40:00.044789","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.437554","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.930560","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:00.930560","last_peered":"2024-03-24 10:40:00.930560","last_clean":"2024-03-24 10:40:00.930560","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:00.930560","last_undegraded":"2024-03-24 10:40:00.930560","last_fullsized":"2024-03-24 10:40:00.930560","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.434646","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044784","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:00.044784","last_peered":"2024-03-24 10:40:00.044784","last_clean":"2024-03-24 10:40:00.044784","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:00.044784","last_undegraded":"2024-03-24 10:40:00.044784","last_fullsized":"2024-03-24 10:40:00.044784","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441325","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240185","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:39:59.240185","last_peered":"2024-03-24 10:39:59.240185","last_clean":"2024-03-24 10:39:59.240185","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:39:59.240185","last_undegraded":"2024-03-24 10:39:59.240185","last_fullsized":"2024-03-24 10:39:59.240185","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.439224","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:39:59.240230","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:39:59.240230","last_peered":"2024-03-24 10:39:59.240230","last_clean":"2024-03-24 10:39:59.240230","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:39:59.240230","last_undegraded":"2024-03-24 10:39:59.240230","last_fullsized":"2024-03-24 10:39:59.240230","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-03-24 10:40:04.429389","last_change":"2024-03-24 10:40:04.429389","last_active":"2024-03-24 10:40:04.429389","last_peered":"2024-03-24 10:40:04.429389","last_clean":"2024-03-24 10:40:04.429389","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:04.429389","last_undegraded":"2024-03-24 10:40:04.429389","last_fullsized":"2024-03-24 10:40:04.429389","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"creating+peering","last_fresh":"2024-03-24 10:40:03.425851","last_change":"2024-03-24 10:40:03.441010","last_active":"2024-03-24 10:40:03.425851","last_peered":"2024-03-24 10:40:03.425851","last_clean":"2024-03-24 10:40:03.425851","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24 10:40:03.425851","last_undegraded":"2024-03-24 10:40:03.425851","last_fullsized":"2024-03-24 10:40:03.425851","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2024-03-24 10:40:00.044781","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:00.044781","last_peered":"2024-03-24 10:40:00.044781","last_clean":"2024-03-24 10:40:00.044781","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:00.044781","last_undegraded":"2024-03-24 10:40:00.044781","last_fullsized":"2024-03-24 10:40:00.044781","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}]}} 2024-03-24T10:40:11.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.081 7fd46e11a700 1 Processor -- start 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.081 7fd46e11a700 1 -- start start 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd46e11a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd46e11a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 0x7fd4681a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd46e11a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46810bd60 con 0x7fd4680f5a10 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd46e11a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680fa590 con 0x7fd4681a59d0 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd46e11a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681a0c50 con 0x7fd46810b910 2024-03-24T10:40:12.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42480/0 (socket says 172.21.15.73:42480) 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd4675c7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 0x7fd4681a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 -- 172.21.15.73:0/3103976207 learned_addr learned my addr 172.21.15.73:0/3103976207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd466dc6700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd4680f5a10 0x7fd46810b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41834/0 (socket says 172.21.15.73:41834) 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd4665c5700 1 -- 172.21.15.73:0/3103976207 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546678812 0 0) 0x7fd458001110 con 0x7fd4680f5a10 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd4665c5700 1 -- 172.21.15.73:0/3103976207 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd448003270 con 0x7fd4680f5a10 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 -- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 msgr2=0x7fd4681a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 0x7fd4681a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 -- 172.21.15.73:0/3103976207 >> v1:172.21.15.73:6789/0 conn(0x7fd4680f5a10 legacy=0x7fd46810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.082 7fd45ffff700 1 -- 172.21.15.73:0/3103976207 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680f1890 con 0x7fd46810b910 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd4675c7700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 0x7fd4681a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd45ffff700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd4680f47c0 tx=0x7fd450009a30).ready entity=mon.2 client_cookie=f047da01b9579189 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd4665c5700 1 -- 172.21.15.73:0/3103976207 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4680f1890 con 0x7fd46810b910 2024-03-24T10:40:12.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd4665c5700 1 -- 172.21.15.73:0/3103976207 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45000f510 con 0x7fd46810b910 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd4665c5700 1 -- 172.21.15.73:0/3103976207 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd45000f6f0 con 0x7fd46810b910 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 -- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 msgr2=0x7fd4681a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd4680f47c0 tx=0x7fd450009a30).stop 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 -- 172.21.15.73:0/3103976207 shutdown_connections 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681a59d0 0x7fd4681a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 --2- 172.21.15.73:0/3103976207 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd46810b910 0x7fd4681a53a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 -- 172.21.15.73:0/3103976207 >> 172.21.15.73:0/3103976207 conn(0x7fd468113a70 msgr2=0x7fd4680f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 -- 172.21.15.73:0/3103976207 shutdown_connections 2024-03-24T10:40:12.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.083 7fd46e11a700 1 -- 172.21.15.73:0/3103976207 wait complete. 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.106 7fd46e11a700 1 Processor -- start 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.106 7fd46e11a700 1 -- start start 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4681b2600 0x7fd4681b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4681b3080 0x7fd4681b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680e6530 con 0x7fd4681b2600 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680e0c60 con 0x7fd4681b1b80 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680e09a0 con 0x7fd4681b3080 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60140/0 (socket says 172.21.15.73:60140) 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 -- 172.21.15.73:0/3670342010 learned_addr learned my addr 172.21.15.73:0/3670342010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd45ffff700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4681b2600 0x7fd4681b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd4675c7700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4681b3080 0x7fd4681b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 -- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4681b3080 msgr2=0x7fd4681b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4681b3080 0x7fd4681b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 -- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4681b2600 msgr2=0x7fd4681b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4681b2600 0x7fd4681b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 -- 172.21.15.73:0/3670342010 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680e0580 con 0x7fd4681b1b80 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd466dc6700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd4680c1600 tx=0x7fd45800c7b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4680e0580 con 0x7fd4681b1b80 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580072e0 con 0x7fd4681b1b80 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4680bb1f0 con 0x7fd4681b1b80 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.107 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd458005750 con 0x7fd4681b1b80 2024-03-24T10:40:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.108 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4681b36b0 con 0x7fd4681b1b80 2024-03-24T10:40:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.108 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd458005950 con 0x7fd4681b1b80 2024-03-24T10:40:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.108 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd458014d10 con 0x7fd4681b1b80 2024-03-24T10:40:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.108 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4680f08e0 con 0x7fd4681b1b80 2024-03-24T10:40:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.112 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd4580070d0 con 0x7fd4681b1b80 2024-03-24T10:40:12.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.213 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fd468087810 con 0x7fd44c014540 2024-03-24T10:40:12.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.221 7fd464dc2700 1 -- 172.21.15.73:0/3670342010 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307358 (unknown 2965378022 0 3551557686) 0x7fd450006bf0 con 0x7fd44c014540 2024-03-24T10:40:12.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:12.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 >> v1:172.21.15.73:6816/43277 conn(0x7fd44c014540 legacy=0x7fd44c016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 msgr2=0x7fd4681b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd4680c1600 tx=0x7fd45800c7b0).stop 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 shutdown_connections 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4681b3080 0x7fd4681b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4681b1b80 0x7fd4681b1fd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 --2- 172.21.15.73:0/3670342010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4681b2600 0x7fd4681b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 >> 172.21.15.73:0/3670342010 conn(0x7fd4680db970 msgr2=0x7fd4680c05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 shutdown_connections 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.223 7fd46e11a700 1 -- 172.21.15.73:0/3670342010 wait complete. 2024-03-24T10:40:12.228 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:12.234 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-24 10:40:11.121840","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195264,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292096,"statfs":{"total":386547056640,"available":382251106304,"internally_reserved":4294967296,"allocated":950272,"data_stored":284868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3463,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.102106"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.800340","last_change":"2024-03-24 10:40:04.797232","last_active":"2024-03-24 10:40:04.800340","last_peered":"2024-03-24 10:40:04.800340","last_clean":"2024-03-24 10:40:04.800340","last_became_active":"2024-03-24 10:40:04.796726","last_became_peered":"2024-03-24 10:40:04.796726","last_unstale":"2024-03-24 10:40:04.800340","last_undegraded":"2024-03-24 10:40:04.800340","last_fullsized":"2024-03-24 10:40:04.800340","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822798","last_change":"2024-03-24 10:40:04.466222","last_active":"2024-03-24 10:40:04.822798","last_peered":"2024-03-24 10:40:04.822798","last_clean":"2024-03-24 10:40:04.822798","last_became_active":"2024-03-24 10:40:04.465916","last_became_peered":"2024-03-24 10:40:04.465916","last_unstale":"2024-03-24 10:40:04.822798","last_undegraded":"2024-03-24 10:40:04.822798","last_fullsized":"2024-03-24 10:40:04.822798","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.809606","last_change":"2024-03-24 10:40:04.797230","last_active":"2024-03-24 10:40:04.809606","last_peered":"2024-03-24 10:40:04.809606","last_clean":"2024-03-24 10:40:04.809606","last_became_active":"2024-03-24 10:40:04.796986","last_became_peered":"2024-03-24 10:40:04.796986","last_unstale":"2024-03-24 10:40:04.809606","last_undegraded":"2024-03-24 10:40:04.809606","last_fullsized":"2024-03-24 10:40:04.809606","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794599","last_change":"2024-03-24 10:40:04.455539","last_active":"2024-03-24 10:40:04.794599","last_peered":"2024-03-24 10:40:04.794599","last_clean":"2024-03-24 10:40:04.794599","last_became_active":"2024-03-24 10:40:04.455228","last_became_peered":"2024-03-24 10:40:04.455228","last_unstale":"2024-03-24 10:40:04.794599","last_undegraded":"2024-03-24 10:40:04.794599","last_fullsized":"2024-03-24 10:40:04.794599","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.819690","last_change":"2024-03-24 10:40:04.813344","last_active":"2024-03-24 10:40:04.819690","last_peered":"2024-03-24 10:40:04.819690","last_clean":"2024-03-24 10:40:04.819690","last_became_active":"2024-03-24 10:40:04.813042","last_became_peered":"2024-03-24 10:40:04.813042","last_unstale":"2024-03-24 10:40:04.819690","last_undegraded":"2024-03-24 10:40:04.819690","last_fullsized":"2024-03-24 10:40:04.819690","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.796073","last_change":"2024-03-24 10:40:04.459112","last_active":"2024-03-24 10:40:04.796073","last_peered":"2024-03-24 10:40:04.796073","last_clean":"2024-03-24 10:40:04.796073","last_became_active":"2024-03-24 10:40:04.458796","last_became_peered":"2024-03-24 10:40:04.458796","last_unstale":"2024-03-24 10:40:04.796073","last_undegraded":"2024-03-24 10:40:04.796073","last_fullsized":"2024-03-24 10:40:04.796073","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.819917","last_change":"2024-03-24 10:40:04.814235","last_active":"2024-03-24 10:40:04.819917","last_peered":"2024-03-24 10:40:04.819917","last_clean":"2024-03-24 10:40:04.819917","last_became_active":"2024-03-24 10:40:04.813182","last_became_peered":"2024-03-24 10:40:04.813182","last_unstale":"2024-03-24 10:40:04.819917","last_undegraded":"2024-03-24 10:40:04.819917","last_fullsized":"2024-03-24 10:40:04.819917","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.816313","last_change":"2024-03-24 10:40:04.471137","last_active":"2024-03-24 10:40:04.816313","last_peered":"2024-03-24 10:40:04.816313","last_clean":"2024-03-24 10:40:04.816313","last_became_active":"2024-03-24 10:40:04.468277","last_became_peered":"2024-03-24 10:40:04.468277","last_unstale":"2024-03-24 10:40:04.816313","last_undegraded":"2024-03-24 10:40:04.816313","last_fullsized":"2024-03-24 10:40:04.816313","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794894","last_change":"2024-03-24 10:40:04.790775","last_active":"2024-03-24 10:40:04.794894","last_peered":"2024-03-24 10:40:04.794894","last_clean":"2024-03-24 10:40:04.794894","last_became_active":"2024-03-24 10:40:04.790518","last_became_peered":"2024-03-24 10:40:04.790518","last_unstale":"2024-03-24 10:40:04.794894","last_undegraded":"2024-03-24 10:40:04.794894","last_fullsized":"2024-03-24 10:40:04.794894","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.818309","last_change":"2024-03-24 10:40:04.465709","last_active":"2024-03-24 10:40:04.818309","last_peered":"2024-03-24 10:40:04.818309","last_clean":"2024-03-24 10:40:04.818309","last_became_active":"2024-03-24 10:40:04.465045","last_became_peered":"2024-03-24 10:40:04.465045","last_unstale":"2024-03-24 10:40:04.818309","last_undegraded":"2024-03-24 10:40:04.818309","last_fullsized":"2024-03-24 10:40:04.818309","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810449","last_change":"2024-03-24 10:40:04.804932","last_active":"2024-03-24 10:40:04.810449","last_peered":"2024-03-24 10:40:04.810449","last_clean":"2024-03-24 10:40:04.810449","last_became_active":"2024-03-24 10:40:04.794752","last_became_peered":"2024-03-24 10:40:04.794752","last_unstale":"2024-03-24 10:40:04.810449","last_undegraded":"2024-03-24 10:40:04.810449","last_fullsized":"2024-03-24 10:40:04.810449","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820989","last_change":"2024-03-24 10:40:04.465711","last_active":"2024-03-24 10:40:04.820989","last_peered":"2024-03-24 10:40:04.820989","last_clean":"2024-03-24 10:40:04.820989","last_became_active":"2024-03-24 10:40:04.465355","last_became_peered":"2024-03-24 10:40:04.465355","last_unstale":"2024-03-24 10:40:04.820989","last_undegraded":"2024-03-24 10:40:04.820989","last_fullsized":"2024-03-24 10:40:04.820989","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810591","last_change":"2024-03-24 10:40:04.804276","last_active":"2024-03-24 10:40:04.810591","last_peered":"2024-03-24 10:40:04.810591","last_clean":"2024-03-24 10:40:04.810591","last_became_active":"2024-03-24 10:40:04.803134","last_became_peered":"2024-03-24 10:40:04.803134","last_unstale":"2024-03-24 10:40:04.810591","last_undegraded":"2024-03-24 10:40:04.810591","last_fullsized":"2024-03-24 10:40:04.810591","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786631","last_change":"2024-03-24 10:40:04.465954","last_active":"2024-03-24 10:40:04.786631","last_peered":"2024-03-24 10:40:04.786631","last_clean":"2024-03-24 10:40:04.786631","last_became_active":"2024-03-24 10:40:04.465458","last_became_peered":"2024-03-24 10:40:04.465458","last_unstale":"2024-03-24 10:40:04.786631","last_undegraded":"2024-03-24 10:40:04.786631","last_fullsized":"2024-03-24 10:40:04.786631","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.809745","last_change":"2024-03-24 10:40:04.803324","last_active":"2024-03-24 10:40:04.809745","last_peered":"2024-03-24 10:40:04.809745","last_clean":"2024-03-24 10:40:04.809745","last_became_active":"2024-03-24 10:40:04.803008","last_became_peered":"2024-03-24 10:40:04.803008","last_unstale":"2024-03-24 10:40:04.809745","last_undegraded":"2024-03-24 10:40:04.809745","last_fullsized":"2024-03-24 10:40:04.809745","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792230","last_change":"2024-03-24 10:40:04.459065","last_active":"2024-03-24 10:40:04.792230","last_peered":"2024-03-24 10:40:04.792230","last_clean":"2024-03-24 10:40:04.792230","last_became_active":"2024-03-24 10:40:04.458064","last_became_peered":"2024-03-24 10:40:04.458064","last_unstale":"2024-03-24 10:40:04.792230","last_undegraded":"2024-03-24 10:40:04.792230","last_fullsized":"2024-03-24 10:40:04.792230","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822157","last_change":"2024-03-24 10:40:04.819386","last_active":"2024-03-24 10:40:04.822157","last_peered":"2024-03-24 10:40:04.822157","last_clean":"2024-03-24 10:40:04.822157","last_became_active":"2024-03-24 10:40:04.819049","last_became_peered":"2024-03-24 10:40:04.819049","last_unstale":"2024-03-24 10:40:04.822157","last_undegraded":"2024-03-24 10:40:04.822157","last_fullsized":"2024-03-24 10:40:04.822157","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.798237","last_change":"2024-03-24 10:40:04.467752","last_active":"2024-03-24 10:40:04.798237","last_peered":"2024-03-24 10:40:04.798237","last_clean":"2024-03-24 10:40:04.798237","last_became_active":"2024-03-24 10:40:04.467316","last_became_peered":"2024-03-24 10:40:04.467316","last_unstale":"2024-03-24 10:40:04.798237","last_undegraded":"2024-03-24 10:40:04.798237","last_fullsized":"2024-03-24 10:40:04.798237","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821537","last_change":"2024-03-24 10:40:04.817292","last_active":"2024-03-24 10:40:04.821537","last_peered":"2024-03-24 10:40:04.821537","last_clean":"2024-03-24 10:40:04.821537","last_became_active":"2024-03-24 10:40:04.815179","last_became_peered":"2024-03-24 10:40:04.815179","last_unstale":"2024-03-24 10:40:04.821537","last_undegraded":"2024-03-24 10:40:04.821537","last_fullsized":"2024-03-24 10:40:04.821537","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.798087","last_change":"2024-03-24 10:40:04.458588","last_active":"2024-03-24 10:40:04.798087","last_peered":"2024-03-24 10:40:04.798087","last_clean":"2024-03-24 10:40:04.798087","last_became_active":"2024-03-24 10:40:04.458298","last_became_peered":"2024-03-24 10:40:04.458298","last_unstale":"2024-03-24 10:40:04.798087","last_undegraded":"2024-03-24 10:40:04.798087","last_fullsized":"2024-03-24 10:40:04.798087","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.819771","last_change":"2024-03-24 10:40:04.813818","last_active":"2024-03-24 10:40:04.819771","last_peered":"2024-03-24 10:40:04.819771","last_clean":"2024-03-24 10:40:04.819771","last_became_active":"2024-03-24 10:40:04.812322","last_became_peered":"2024-03-24 10:40:04.812322","last_unstale":"2024-03-24 10:40:04.819771","last_undegraded":"2024-03-24 10:40:04.819771","last_fullsized":"2024-03-24 10:40:04.819771","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.796321","last_change":"2024-03-24 10:40:04.458769","last_active":"2024-03-24 10:40:04.796321","last_peered":"2024-03-24 10:40:04.796321","last_clean":"2024-03-24 10:40:04.796321","last_became_active":"2024-03-24 10:40:04.458435","last_became_peered":"2024-03-24 10:40:04.458435","last_unstale":"2024-03-24 10:40:04.796321","last_undegraded":"2024-03-24 10:40:04.796321","last_fullsized":"2024-03-24 10:40:04.796321","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822540","last_change":"2024-03-24 10:40:04.819808","last_active":"2024-03-24 10:40:04.822540","last_peered":"2024-03-24 10:40:04.822540","last_clean":"2024-03-24 10:40:04.822540","last_became_active":"2024-03-24 10:40:04.819098","last_became_peered":"2024-03-24 10:40:04.819098","last_unstale":"2024-03-24 10:40:04.822540","last_undegraded":"2024-03-24 10:40:04.822540","last_fullsized":"2024-03-24 10:40:04.822540","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.824623","last_change":"2024-03-24 10:40:04.447940","last_active":"2024-03-24 10:40:04.824623","last_peered":"2024-03-24 10:40:04.824623","last_clean":"2024-03-24 10:40:04.824623","last_became_active":"2024-03-24 10:40:04.447220","last_became_peered":"2024-03-24 10:40:04.447220","last_unstale":"2024-03-24 10:40:04.824623","last_undegraded":"2024-03-24 10:40:04.824623","last_fullsized":"2024-03-24 10:40:04.824623","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822359","last_change":"2024-03-24 10:40:04.813759","last_active":"2024-03-24 10:40:04.822359","last_peered":"2024-03-24 10:40:04.822359","last_clean":"2024-03-24 10:40:04.822359","last_became_active":"2024-03-24 10:40:04.809773","last_became_peered":"2024-03-24 10:40:04.809773","last_unstale":"2024-03-24 10:40:04.822359","last_undegraded":"2024-03-24 10:40:04.822359","last_fullsized":"2024-03-24 10:40:04.822359","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810534","last_change":"2024-03-24 10:40:04.450978","last_active":"2024-03-24 10:40:04.810534","last_peered":"2024-03-24 10:40:04.810534","last_clean":"2024-03-24 10:40:04.810534","last_became_active":"2024-03-24 10:40:04.450481","last_became_peered":"2024-03-24 10:40:04.450481","last_unstale":"2024-03-24 10:40:04.810534","last_undegraded":"2024-03-24 10:40:04.810534","last_fullsized":"2024-03-24 10:40:04.810534","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810407","last_change":"2024-03-24 10:40:04.803518","last_active":"2024-03-24 10:40:04.810407","last_peered":"2024-03-24 10:40:04.810407","last_clean":"2024-03-24 10:40:04.810407","last_became_active":"2024-03-24 10:40:04.803019","last_became_peered":"2024-03-24 10:40:04.803019","last_unstale":"2024-03-24 10:40:04.810407","last_undegraded":"2024-03-24 10:40:04.810407","last_fullsized":"2024-03-24 10:40:04.810407","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.784485","last_change":"2024-03-24 10:40:04.460741","last_active":"2024-03-24 10:40:04.784485","last_peered":"2024-03-24 10:40:04.784485","last_clean":"2024-03-24 10:40:04.784485","last_became_active":"2024-03-24 10:40:04.460423","last_became_peered":"2024-03-24 10:40:04.460423","last_unstale":"2024-03-24 10:40:04.784485","last_undegraded":"2024-03-24 10:40:04.784485","last_fullsized":"2024-03-24 10:40:04.784485","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810417","last_change":"2024-03-24 10:40:04.795922","last_active":"2024-03-24 10:40:04.810417","last_peered":"2024-03-24 10:40:04.810417","last_clean":"2024-03-24 10:40:04.810417","last_became_active":"2024-03-24 10:40:04.795602","last_became_peered":"2024-03-24 10:40:04.795602","last_unstale":"2024-03-24 10:40:04.810417","last_undegraded":"2024-03-24 10:40:04.810417","last_fullsized":"2024-03-24 10:40:04.810417","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792273","last_change":"2024-03-24 10:40:04.460659","last_active":"2024-03-24 10:40:04.792273","last_peered":"2024-03-24 10:40:04.792273","last_clean":"2024-03-24 10:40:04.792273","last_became_active":"2024-03-24 10:40:04.460323","last_became_peered":"2024-03-24 10:40:04.460323","last_unstale":"2024-03-24 10:40:04.792273","last_undegraded":"2024-03-24 10:40:04.792273","last_fullsized":"2024-03-24 10:40:04.792273","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815836","last_change":"2024-03-24 10:40:04.808887","last_active":"2024-03-24 10:40:04.815836","last_peered":"2024-03-24 10:40:04.815836","last_clean":"2024-03-24 10:40:04.815836","last_became_active":"2024-03-24 10:40:04.808593","last_became_peered":"2024-03-24 10:40:04.808593","last_unstale":"2024-03-24 10:40:04.815836","last_undegraded":"2024-03-24 10:40:04.815836","last_fullsized":"2024-03-24 10:40:04.815836","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822750","last_change":"2024-03-24 10:40:04.465591","last_active":"2024-03-24 10:40:04.822750","last_peered":"2024-03-24 10:40:04.822750","last_clean":"2024-03-24 10:40:04.822750","last_became_active":"2024-03-24 10:40:04.465236","last_became_peered":"2024-03-24 10:40:04.465236","last_unstale":"2024-03-24 10:40:04.822750","last_undegraded":"2024-03-24 10:40:04.822750","last_fullsized":"2024-03-24 10:40:04.822750","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821665","last_change":"2024-03-24 10:40:04.811522","last_active":"2024-03-24 10:40:04.821665","last_peered":"2024-03-24 10:40:04.821665","last_clean":"2024-03-24 10:40:04.821665","last_became_active":"2024-03-24 10:40:04.811194","last_became_peered":"2024-03-24 10:40:04.811194","last_unstale":"2024-03-24 10:40:04.821665","last_undegraded":"2024-03-24 10:40:04.821665","last_fullsized":"2024-03-24 10:40:04.821665","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.798331","last_change":"2024-03-24 10:40:04.467594","last_active":"2024-03-24 10:40:04.798331","last_peered":"2024-03-24 10:40:04.798331","last_clean":"2024-03-24 10:40:04.798331","last_became_active":"2024-03-24 10:40:04.467100","last_became_peered":"2024-03-24 10:40:04.467100","last_unstale":"2024-03-24 10:40:04.798331","last_undegraded":"2024-03-24 10:40:04.798331","last_fullsized":"2024-03-24 10:40:04.798331","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822419","last_change":"2024-03-24 10:40:04.818020","last_active":"2024-03-24 10:40:04.822419","last_peered":"2024-03-24 10:40:04.822419","last_clean":"2024-03-24 10:40:04.822419","last_became_active":"2024-03-24 10:40:04.813302","last_became_peered":"2024-03-24 10:40:04.813302","last_unstale":"2024-03-24 10:40:04.822419","last_undegraded":"2024-03-24 10:40:04.822419","last_fullsized":"2024-03-24 10:40:04.822419","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.798789","last_change":"2024-03-24 10:40:04.463260","last_active":"2024-03-24 10:40:04.798789","last_peered":"2024-03-24 10:40:04.798789","last_clean":"2024-03-24 10:40:04.798789","last_became_active":"2024-03-24 10:40:04.462941","last_became_peered":"2024-03-24 10:40:04.462941","last_unstale":"2024-03-24 10:40:04.798789","last_undegraded":"2024-03-24 10:40:04.798789","last_fullsized":"2024-03-24 10:40:04.798789","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.814040","last_change":"2024-03-24 10:40:04.808406","last_active":"2024-03-24 10:40:04.814040","last_peered":"2024-03-24 10:40:04.814040","last_clean":"2024-03-24 10:40:04.814040","last_became_active":"2024-03-24 10:40:04.808025","last_became_peered":"2024-03-24 10:40:04.808025","last_unstale":"2024-03-24 10:40:04.814040","last_undegraded":"2024-03-24 10:40:04.814040","last_fullsized":"2024-03-24 10:40:04.814040","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815670","last_change":"2024-03-24 10:40:04.463319","last_active":"2024-03-24 10:40:04.815670","last_peered":"2024-03-24 10:40:04.815670","last_clean":"2024-03-24 10:40:04.815670","last_became_active":"2024-03-24 10:40:04.462999","last_became_peered":"2024-03-24 10:40:04.462999","last_unstale":"2024-03-24 10:40:04.815670","last_undegraded":"2024-03-24 10:40:04.815670","last_fullsized":"2024-03-24 10:40:04.815670","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822557","last_change":"2024-03-24 10:40:04.819953","last_active":"2024-03-24 10:40:04.822557","last_peered":"2024-03-24 10:40:04.822557","last_clean":"2024-03-24 10:40:04.822557","last_became_active":"2024-03-24 10:40:04.819310","last_became_peered":"2024-03-24 10:40:04.819310","last_unstale":"2024-03-24 10:40:04.822557","last_undegraded":"2024-03-24 10:40:04.822557","last_fullsized":"2024-03-24 10:40:04.822557","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791155","last_change":"2024-03-24 10:40:04.470067","last_active":"2024-03-24 10:40:04.791155","last_peered":"2024-03-24 10:40:04.791155","last_clean":"2024-03-24 10:40:04.791155","last_became_active":"2024-03-24 10:40:04.469313","last_became_peered":"2024-03-24 10:40:04.469313","last_unstale":"2024-03-24 10:40:04.791155","last_undegraded":"2024-03-24 10:40:04.791155","last_fullsized":"2024-03-24 10:40:04.791155","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.809358","last_change":"2024-03-24 10:40:04.798026","last_active":"2024-03-24 10:40:04.809358","last_peered":"2024-03-24 10:40:04.809358","last_clean":"2024-03-24 10:40:04.809358","last_became_active":"2024-03-24 10:40:04.797583","last_became_peered":"2024-03-24 10:40:04.797583","last_unstale":"2024-03-24 10:40:04.809358","last_undegraded":"2024-03-24 10:40:04.809358","last_fullsized":"2024-03-24 10:40:04.809358","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821817","last_change":"2024-03-24 10:40:04.473457","last_active":"2024-03-24 10:40:04.821817","last_peered":"2024-03-24 10:40:04.821817","last_clean":"2024-03-24 10:40:04.821817","last_became_active":"2024-03-24 10:40:04.473124","last_became_peered":"2024-03-24 10:40:04.473124","last_unstale":"2024-03-24 10:40:04.821817","last_undegraded":"2024-03-24 10:40:04.821817","last_fullsized":"2024-03-24 10:40:04.821817","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815995","last_change":"2024-03-24 10:40:04.808549","last_active":"2024-03-24 10:40:04.815995","last_peered":"2024-03-24 10:40:04.815995","last_clean":"2024-03-24 10:40:04.815995","last_became_active":"2024-03-24 10:40:04.808242","last_became_peered":"2024-03-24 10:40:04.808242","last_unstale":"2024-03-24 10:40:04.815995","last_undegraded":"2024-03-24 10:40:04.815995","last_fullsized":"2024-03-24 10:40:04.815995","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791419","last_change":"2024-03-24 10:40:04.459642","last_active":"2024-03-24 10:40:04.791419","last_peered":"2024-03-24 10:40:04.791419","last_clean":"2024-03-24 10:40:04.791419","last_became_active":"2024-03-24 10:40:04.459353","last_became_peered":"2024-03-24 10:40:04.459353","last_unstale":"2024-03-24 10:40:04.791419","last_undegraded":"2024-03-24 10:40:04.791419","last_fullsized":"2024-03-24 10:40:04.791419","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.807411","last_change":"2024-03-24 10:40:04.794640","last_active":"2024-03-24 10:40:04.807411","last_peered":"2024-03-24 10:40:04.807411","last_clean":"2024-03-24 10:40:04.807411","last_became_active":"2024-03-24 10:40:04.794319","last_became_peered":"2024-03-24 10:40:04.794319","last_unstale":"2024-03-24 10:40:04.807411","last_undegraded":"2024-03-24 10:40:04.807411","last_fullsized":"2024-03-24 10:40:04.807411","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785595","last_change":"2024-03-24 10:40:04.466119","last_active":"2024-03-24 10:40:04.785595","last_peered":"2024-03-24 10:40:04.785595","last_clean":"2024-03-24 10:40:04.785595","last_became_active":"2024-03-24 10:40:04.465668","last_became_peered":"2024-03-24 10:40:04.465668","last_unstale":"2024-03-24 10:40:04.785595","last_undegraded":"2024-03-24 10:40:04.785595","last_fullsized":"2024-03-24 10:40:04.785595","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815745","last_change":"2024-03-24 10:40:04.807564","last_active":"2024-03-24 10:40:04.815745","last_peered":"2024-03-24 10:40:04.815745","last_clean":"2024-03-24 10:40:04.815745","last_became_active":"2024-03-24 10:40:04.807248","last_became_peered":"2024-03-24 10:40:04.807248","last_unstale":"2024-03-24 10:40:04.815745","last_undegraded":"2024-03-24 10:40:04.815745","last_fullsized":"2024-03-24 10:40:04.815745","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792284","last_change":"2024-03-24 10:40:04.471732","last_active":"2024-03-24 10:40:04.792284","last_peered":"2024-03-24 10:40:04.792284","last_clean":"2024-03-24 10:40:04.792284","last_became_active":"2024-03-24 10:40:04.469036","last_became_peered":"2024-03-24 10:40:04.469036","last_unstale":"2024-03-24 10:40:04.792284","last_undegraded":"2024-03-24 10:40:04.792284","last_fullsized":"2024-03-24 10:40:04.792284","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821687","last_change":"2024-03-24 10:40:04.812190","last_active":"2024-03-24 10:40:04.821687","last_peered":"2024-03-24 10:40:04.821687","last_clean":"2024-03-24 10:40:04.821687","last_became_active":"2024-03-24 10:40:04.811872","last_became_peered":"2024-03-24 10:40:04.811872","last_unstale":"2024-03-24 10:40:04.821687","last_undegraded":"2024-03-24 10:40:04.821687","last_fullsized":"2024-03-24 10:40:04.821687","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799089","last_change":"2024-03-24 10:40:04.475506","last_active":"2024-03-24 10:40:04.799089","last_peered":"2024-03-24 10:40:04.799089","last_clean":"2024-03-24 10:40:04.799089","last_became_active":"2024-03-24 10:40:04.475241","last_became_peered":"2024-03-24 10:40:04.475241","last_unstale":"2024-03-24 10:40:04.799089","last_undegraded":"2024-03-24 10:40:04.799089","last_fullsized":"2024-03-24 10:40:04.799089","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.818024","last_change":"2024-03-24 10:40:04.812352","last_active":"2024-03-24 10:40:04.818024","last_peered":"2024-03-24 10:40:04.818024","last_clean":"2024-03-24 10:40:04.818024","last_became_active":"2024-03-24 10:40:04.812106","last_became_peered":"2024-03-24 10:40:04.812106","last_unstale":"2024-03-24 10:40:04.818024","last_undegraded":"2024-03-24 10:40:04.818024","last_fullsized":"2024-03-24 10:40:04.818024","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"25'1","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2024-03-24 10:40:06.892831","last_change":"2024-03-24 10:40:04.463347","last_active":"2024-03-24 10:40:06.892831","last_peered":"2024-03-24 10:40:06.892831","last_clean":"2024-03-24 10:40:06.892831","last_became_active":"2024-03-24 10:40:04.463024","last_became_peered":"2024-03-24 10:40:04.463024","last_unstale":"2024-03-24 10:40:06.892831","last_undegraded":"2024-03-24 10:40:06.892831","last_fullsized":"2024-03-24 10:40:06.892831","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.814001","last_change":"2024-03-24 10:40:04.808228","last_active":"2024-03-24 10:40:04.814001","last_peered":"2024-03-24 10:40:04.814001","last_clean":"2024-03-24 10:40:04.814001","last_became_active":"2024-03-24 10:40:04.807816","last_became_peered":"2024-03-24 10:40:04.807816","last_unstale":"2024-03-24 10:40:04.814001","last_undegraded":"2024-03-24 10:40:04.814001","last_fullsized":"2024-03-24 10:40:04.814001","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786197","last_change":"2024-03-24 10:40:04.479407","last_active":"2024-03-24 10:40:04.786197","last_peered":"2024-03-24 10:40:04.786197","last_clean":"2024-03-24 10:40:04.786197","last_became_active":"2024-03-24 10:40:04.479105","last_became_peered":"2024-03-24 10:40:04.479105","last_unstale":"2024-03-24 10:40:04.786197","last_undegraded":"2024-03-24 10:40:04.786197","last_fullsized":"2024-03-24 10:40:04.786197","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820394","last_change":"2024-03-24 10:40:04.814902","last_active":"2024-03-24 10:40:04.820394","last_peered":"2024-03-24 10:40:04.820394","last_clean":"2024-03-24 10:40:04.820394","last_became_active":"2024-03-24 10:40:04.814602","last_became_peered":"2024-03-24 10:40:04.814602","last_unstale":"2024-03-24 10:40:04.820394","last_undegraded":"2024-03-24 10:40:04.820394","last_fullsized":"2024-03-24 10:40:04.820394","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791255","last_change":"2024-03-24 10:40:04.469662","last_active":"2024-03-24 10:40:04.791255","last_peered":"2024-03-24 10:40:04.791255","last_clean":"2024-03-24 10:40:04.791255","last_became_active":"2024-03-24 10:40:04.467803","last_became_peered":"2024-03-24 10:40:04.467803","last_unstale":"2024-03-24 10:40:04.791255","last_undegraded":"2024-03-24 10:40:04.791255","last_fullsized":"2024-03-24 10:40:04.791255","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810496","last_change":"2024-03-24 10:40:04.796390","last_active":"2024-03-24 10:40:04.810496","last_peered":"2024-03-24 10:40:04.810496","last_clean":"2024-03-24 10:40:04.810496","last_became_active":"2024-03-24 10:40:04.796090","last_became_peered":"2024-03-24 10:40:04.796090","last_unstale":"2024-03-24 10:40:04.810496","last_undegraded":"2024-03-24 10:40:04.810496","last_fullsized":"2024-03-24 10:40:04.810496","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786704","last_change":"2024-03-24 10:40:04.472128","last_active":"2024-03-24 10:40:04.786704","last_peered":"2024-03-24 10:40:04.786704","last_clean":"2024-03-24 10:40:04.786704","last_became_active":"2024-03-24 10:40:04.471786","last_became_peered":"2024-03-24 10:40:04.471786","last_unstale":"2024-03-24 10:40:04.786704","last_undegraded":"2024-03-24 10:40:04.786704","last_fullsized":"2024-03-24 10:40:04.786704","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.811188","last_change":"2024-03-24 10:40:04.803012","last_active":"2024-03-24 10:40:04.811188","last_peered":"2024-03-24 10:40:04.811188","last_clean":"2024-03-24 10:40:04.811188","last_became_active":"2024-03-24 10:40:04.802757","last_became_peered":"2024-03-24 10:40:04.802757","last_unstale":"2024-03-24 10:40:04.811188","last_undegraded":"2024-03-24 10:40:04.811188","last_fullsized":"2024-03-24 10:40:04.811188","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791427","last_change":"2024-03-24 10:40:04.452785","last_active":"2024-03-24 10:40:04.791427","last_peered":"2024-03-24 10:40:04.791427","last_clean":"2024-03-24 10:40:04.791427","last_became_active":"2024-03-24 10:40:04.452467","last_became_peered":"2024-03-24 10:40:04.452467","last_unstale":"2024-03-24 10:40:04.791427","last_undegraded":"2024-03-24 10:40:04.791427","last_fullsized":"2024-03-24 10:40:04.791427","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822574","last_change":"2024-03-24 10:40:04.814575","last_active":"2024-03-24 10:40:04.822574","last_peered":"2024-03-24 10:40:04.822574","last_clean":"2024-03-24 10:40:04.822574","last_became_active":"2024-03-24 10:40:04.814189","last_became_peered":"2024-03-24 10:40:04.814189","last_unstale":"2024-03-24 10:40:04.822574","last_undegraded":"2024-03-24 10:40:04.822574","last_fullsized":"2024-03-24 10:40:04.822574","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785977","last_change":"2024-03-24 10:40:04.470839","last_active":"2024-03-24 10:40:04.785977","last_peered":"2024-03-24 10:40:04.785977","last_clean":"2024-03-24 10:40:04.785977","last_became_active":"2024-03-24 10:40:04.470514","last_became_peered":"2024-03-24 10:40:04.470514","last_unstale":"2024-03-24 10:40:04.785977","last_undegraded":"2024-03-24 10:40:04.785977","last_fullsized":"2024-03-24 10:40:04.785977","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.807593","last_change":"2024-03-24 10:40:04.802239","last_active":"2024-03-24 10:40:04.807593","last_peered":"2024-03-24 10:40:04.807593","last_clean":"2024-03-24 10:40:04.807593","last_became_active":"2024-03-24 10:40:04.801885","last_became_peered":"2024-03-24 10:40:04.801885","last_unstale":"2024-03-24 10:40:04.807593","last_undegraded":"2024-03-24 10:40:04.807593","last_fullsized":"2024-03-24 10:40:04.807593","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792342","last_change":"2024-03-24 10:40:04.461764","last_active":"2024-03-24 10:40:04.792342","last_peered":"2024-03-24 10:40:04.792342","last_clean":"2024-03-24 10:40:04.792342","last_became_active":"2024-03-24 10:40:04.461439","last_became_peered":"2024-03-24 10:40:04.461439","last_unstale":"2024-03-24 10:40:04.792342","last_undegraded":"2024-03-24 10:40:04.792342","last_fullsized":"2024-03-24 10:40:04.792342","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.795254","last_change":"2024-03-24 10:40:04.791744","last_active":"2024-03-24 10:40:04.795254","last_peered":"2024-03-24 10:40:04.795254","last_clean":"2024-03-24 10:40:04.795254","last_became_active":"2024-03-24 10:40:04.791442","last_became_peered":"2024-03-24 10:40:04.791442","last_unstale":"2024-03-24 10:40:04.795254","last_undegraded":"2024-03-24 10:40:04.795254","last_fullsized":"2024-03-24 10:40:04.795254","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820533","last_change":"2024-03-24 10:40:04.475121","last_active":"2024-03-24 10:40:04.820533","last_peered":"2024-03-24 10:40:04.820533","last_clean":"2024-03-24 10:40:04.820533","last_became_active":"2024-03-24 10:40:04.474515","last_became_peered":"2024-03-24 10:40:04.474515","last_unstale":"2024-03-24 10:40:04.820533","last_undegraded":"2024-03-24 10:40:04.820533","last_fullsized":"2024-03-24 10:40:04.820533","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.814797","last_change":"2024-03-24 10:40:04.805466","last_active":"2024-03-24 10:40:04.814797","last_peered":"2024-03-24 10:40:04.814797","last_clean":"2024-03-24 10:40:04.814797","last_became_active":"2024-03-24 10:40:04.805190","last_became_peered":"2024-03-24 10:40:04.805190","last_unstale":"2024-03-24 10:40:04.814797","last_undegraded":"2024-03-24 10:40:04.814797","last_fullsized":"2024-03-24 10:40:04.814797","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.816151","last_change":"2024-03-24 10:40:04.459923","last_active":"2024-03-24 10:40:04.816151","last_peered":"2024-03-24 10:40:04.816151","last_clean":"2024-03-24 10:40:04.816151","last_became_active":"2024-03-24 10:40:04.459466","last_became_peered":"2024-03-24 10:40:04.459466","last_unstale":"2024-03-24 10:40:04.816151","last_undegraded":"2024-03-24 10:40:04.816151","last_fullsized":"2024-03-24 10:40:04.816151","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.814021","last_change":"2024-03-24 10:40:04.808292","last_active":"2024-03-24 10:40:04.814021","last_peered":"2024-03-24 10:40:04.814021","last_clean":"2024-03-24 10:40:04.814021","last_became_active":"2024-03-24 10:40:04.807951","last_became_peered":"2024-03-24 10:40:04.807951","last_unstale":"2024-03-24 10:40:04.814021","last_undegraded":"2024-03-24 10:40:04.814021","last_fullsized":"2024-03-24 10:40:04.814021","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820981","last_change":"2024-03-24 10:40:04.476131","last_active":"2024-03-24 10:40:04.820981","last_peered":"2024-03-24 10:40:04.820981","last_clean":"2024-03-24 10:40:04.820981","last_became_active":"2024-03-24 10:40:04.475803","last_became_peered":"2024-03-24 10:40:04.475803","last_unstale":"2024-03-24 10:40:04.820981","last_undegraded":"2024-03-24 10:40:04.820981","last_fullsized":"2024-03-24 10:40:04.820981","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820372","last_change":"2024-03-24 10:40:04.814724","last_active":"2024-03-24 10:40:04.820372","last_peered":"2024-03-24 10:40:04.820372","last_clean":"2024-03-24 10:40:04.820372","last_became_active":"2024-03-24 10:40:04.814424","last_became_peered":"2024-03-24 10:40:04.814424","last_unstale":"2024-03-24 10:40:04.820372","last_undegraded":"2024-03-24 10:40:04.820372","last_fullsized":"2024-03-24 10:40:04.820372","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.795048","last_change":"2024-03-24 10:40:04.469799","last_active":"2024-03-24 10:40:04.795048","last_peered":"2024-03-24 10:40:04.795048","last_clean":"2024-03-24 10:40:04.795048","last_became_active":"2024-03-24 10:40:04.469510","last_became_peered":"2024-03-24 10:40:04.469510","last_unstale":"2024-03-24 10:40:04.795048","last_undegraded":"2024-03-24 10:40:04.795048","last_fullsized":"2024-03-24 10:40:04.795048","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.812767","last_change":"2024-03-24 10:40:04.798138","last_active":"2024-03-24 10:40:04.812767","last_peered":"2024-03-24 10:40:04.812767","last_clean":"2024-03-24 10:40:04.812767","last_became_active":"2024-03-24 10:40:04.797810","last_became_peered":"2024-03-24 10:40:04.797810","last_unstale":"2024-03-24 10:40:04.812767","last_undegraded":"2024-03-24 10:40:04.812767","last_fullsized":"2024-03-24 10:40:04.812767","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.793796","last_change":"2024-03-24 10:40:04.473329","last_active":"2024-03-24 10:40:04.793796","last_peered":"2024-03-24 10:40:04.793796","last_clean":"2024-03-24 10:40:04.793796","last_became_active":"2024-03-24 10:40:04.473034","last_became_peered":"2024-03-24 10:40:04.473034","last_unstale":"2024-03-24 10:40:04.793796","last_undegraded":"2024-03-24 10:40:04.793796","last_fullsized":"2024-03-24 10:40:04.793796","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815791","last_change":"2024-03-24 10:40:04.810960","last_active":"2024-03-24 10:40:04.815791","last_peered":"2024-03-24 10:40:04.815791","last_clean":"2024-03-24 10:40:04.815791","last_became_active":"2024-03-24 10:40:04.810676","last_became_peered":"2024-03-24 10:40:04.810676","last_unstale":"2024-03-24 10:40:04.815791","last_undegraded":"2024-03-24 10:40:04.815791","last_fullsized":"2024-03-24 10:40:04.815791","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794009","last_change":"2024-03-24 10:40:04.449495","last_active":"2024-03-24 10:40:04.794009","last_peered":"2024-03-24 10:40:04.794009","last_clean":"2024-03-24 10:40:04.794009","last_became_active":"2024-03-24 10:40:04.447435","last_became_peered":"2024-03-24 10:40:04.447435","last_unstale":"2024-03-24 10:40:04.794009","last_undegraded":"2024-03-24 10:40:04.794009","last_fullsized":"2024-03-24 10:40:04.794009","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.819776","last_change":"2024-03-24 10:40:04.813910","last_active":"2024-03-24 10:40:04.819776","last_peered":"2024-03-24 10:40:04.819776","last_clean":"2024-03-24 10:40:04.819776","last_became_active":"2024-03-24 10:40:04.813611","last_became_peered":"2024-03-24 10:40:04.813611","last_unstale":"2024-03-24 10:40:04.819776","last_undegraded":"2024-03-24 10:40:04.819776","last_fullsized":"2024-03-24 10:40:04.819776","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786034","last_change":"2024-03-24 10:40:04.472834","last_active":"2024-03-24 10:40:04.786034","last_peered":"2024-03-24 10:40:04.786034","last_clean":"2024-03-24 10:40:04.786034","last_became_active":"2024-03-24 10:40:04.472476","last_became_peered":"2024-03-24 10:40:04.472476","last_unstale":"2024-03-24 10:40:04.786034","last_undegraded":"2024-03-24 10:40:04.786034","last_fullsized":"2024-03-24 10:40:04.786034","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.813573","last_change":"2024-03-24 10:40:04.801135","last_active":"2024-03-24 10:40:04.813573","last_peered":"2024-03-24 10:40:04.813573","last_clean":"2024-03-24 10:40:04.813573","last_became_active":"2024-03-24 10:40:04.800846","last_became_peered":"2024-03-24 10:40:04.800846","last_unstale":"2024-03-24 10:40:04.813573","last_undegraded":"2024-03-24 10:40:04.813573","last_fullsized":"2024-03-24 10:40:04.813573","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.789993","last_change":"2024-03-24 10:40:04.448158","last_active":"2024-03-24 10:40:04.789993","last_peered":"2024-03-24 10:40:04.789993","last_clean":"2024-03-24 10:40:04.789993","last_became_active":"2024-03-24 10:40:04.447773","last_became_peered":"2024-03-24 10:40:04.447773","last_unstale":"2024-03-24 10:40:04.789993","last_undegraded":"2024-03-24 10:40:04.789993","last_fullsized":"2024-03-24 10:40:04.789993","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821705","last_change":"2024-03-24 10:40:04.812234","last_active":"2024-03-24 10:40:04.821705","last_peered":"2024-03-24 10:40:04.821705","last_clean":"2024-03-24 10:40:04.821705","last_became_active":"2024-03-24 10:40:04.811937","last_became_peered":"2024-03-24 10:40:04.811937","last_unstale":"2024-03-24 10:40:04.821705","last_undegraded":"2024-03-24 10:40:04.821705","last_fullsized":"2024-03-24 10:40:04.821705","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785272","last_change":"2024-03-24 10:40:04.475117","last_active":"2024-03-24 10:40:04.785272","last_peered":"2024-03-24 10:40:04.785272","last_clean":"2024-03-24 10:40:04.785272","last_became_active":"2024-03-24 10:40:04.474705","last_became_peered":"2024-03-24 10:40:04.474705","last_unstale":"2024-03-24 10:40:04.785272","last_undegraded":"2024-03-24 10:40:04.785272","last_fullsized":"2024-03-24 10:40:04.785272","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822241","last_change":"2024-03-24 10:40:04.812636","last_active":"2024-03-24 10:40:04.822241","last_peered":"2024-03-24 10:40:04.822241","last_clean":"2024-03-24 10:40:04.822241","last_became_active":"2024-03-24 10:40:04.812127","last_became_peered":"2024-03-24 10:40:04.812127","last_unstale":"2024-03-24 10:40:04.822241","last_undegraded":"2024-03-24 10:40:04.822241","last_fullsized":"2024-03-24 10:40:04.822241","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.798986","last_change":"2024-03-24 10:40:04.465426","last_active":"2024-03-24 10:40:04.798986","last_peered":"2024-03-24 10:40:04.798986","last_clean":"2024-03-24 10:40:04.798986","last_became_active":"2024-03-24 10:40:04.465107","last_became_peered":"2024-03-24 10:40:04.465107","last_unstale":"2024-03-24 10:40:04.798986","last_undegraded":"2024-03-24 10:40:04.798986","last_fullsized":"2024-03-24 10:40:04.798986","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821594","last_change":"2024-03-24 10:40:04.811689","last_active":"2024-03-24 10:40:04.821594","last_peered":"2024-03-24 10:40:04.821594","last_clean":"2024-03-24 10:40:04.821594","last_became_active":"2024-03-24 10:40:04.811394","last_became_peered":"2024-03-24 10:40:04.811394","last_unstale":"2024-03-24 10:40:04.821594","last_undegraded":"2024-03-24 10:40:04.821594","last_fullsized":"2024-03-24 10:40:04.821594","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.818603","last_change":"2024-03-24 10:40:04.479397","last_active":"2024-03-24 10:40:04.818603","last_peered":"2024-03-24 10:40:04.818603","last_clean":"2024-03-24 10:40:04.818603","last_became_active":"2024-03-24 10:40:04.479108","last_became_peered":"2024-03-24 10:40:04.479108","last_unstale":"2024-03-24 10:40:04.818603","last_undegraded":"2024-03-24 10:40:04.818603","last_fullsized":"2024-03-24 10:40:04.818603","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822567","last_change":"2024-03-24 10:40:04.820084","last_active":"2024-03-24 10:40:04.822567","last_peered":"2024-03-24 10:40:04.822567","last_clean":"2024-03-24 10:40:04.822567","last_became_active":"2024-03-24 10:40:04.819523","last_became_peered":"2024-03-24 10:40:04.819523","last_unstale":"2024-03-24 10:40:04.822567","last_undegraded":"2024-03-24 10:40:04.822567","last_fullsized":"2024-03-24 10:40:04.822567","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820513","last_change":"2024-03-24 10:40:04.476232","last_active":"2024-03-24 10:40:04.820513","last_peered":"2024-03-24 10:40:04.820513","last_clean":"2024-03-24 10:40:04.820513","last_became_active":"2024-03-24 10:40:04.475911","last_became_peered":"2024-03-24 10:40:04.475911","last_unstale":"2024-03-24 10:40:04.820513","last_undegraded":"2024-03-24 10:40:04.820513","last_fullsized":"2024-03-24 10:40:04.820513","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.812744","last_change":"2024-03-24 10:40:04.797575","last_active":"2024-03-24 10:40:04.812744","last_peered":"2024-03-24 10:40:04.812744","last_clean":"2024-03-24 10:40:04.812744","last_became_active":"2024-03-24 10:40:04.797270","last_became_peered":"2024-03-24 10:40:04.797270","last_unstale":"2024-03-24 10:40:04.812744","last_undegraded":"2024-03-24 10:40:04.812744","last_fullsized":"2024-03-24 10:40:04.812744","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.820883","last_change":"2024-03-24 10:40:04.450804","last_active":"2024-03-24 10:40:04.820883","last_peered":"2024-03-24 10:40:04.820883","last_clean":"2024-03-24 10:40:04.820883","last_became_active":"2024-03-24 10:40:04.450274","last_became_peered":"2024-03-24 10:40:04.450274","last_unstale":"2024-03-24 10:40:04.820883","last_undegraded":"2024-03-24 10:40:04.820883","last_fullsized":"2024-03-24 10:40:04.820883","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.818336","last_change":"2024-03-24 10:40:04.807644","last_active":"2024-03-24 10:40:04.818336","last_peered":"2024-03-24 10:40:04.818336","last_clean":"2024-03-24 10:40:04.818336","last_became_active":"2024-03-24 10:40:04.805925","last_became_peered":"2024-03-24 10:40:04.805925","last_unstale":"2024-03-24 10:40:04.818336","last_undegraded":"2024-03-24 10:40:04.818336","last_fullsized":"2024-03-24 10:40:04.818336","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.784275","last_change":"2024-03-24 10:40:04.469218","last_active":"2024-03-24 10:40:04.784275","last_peered":"2024-03-24 10:40:04.784275","last_clean":"2024-03-24 10:40:04.784275","last_became_active":"2024-03-24 10:40:04.468905","last_became_peered":"2024-03-24 10:40:04.468905","last_unstale":"2024-03-24 10:40:04.784275","last_undegraded":"2024-03-24 10:40:04.784275","last_fullsized":"2024-03-24 10:40:04.784275","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810601","last_change":"2024-03-24 10:40:04.805105","last_active":"2024-03-24 10:40:04.810601","last_peered":"2024-03-24 10:40:04.810601","last_clean":"2024-03-24 10:40:04.810601","last_became_active":"2024-03-24 10:40:04.803347","last_became_peered":"2024-03-24 10:40:04.803347","last_unstale":"2024-03-24 10:40:04.810601","last_undegraded":"2024-03-24 10:40:04.810601","last_fullsized":"2024-03-24 10:40:04.810601","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786311","last_change":"2024-03-24 10:40:04.466689","last_active":"2024-03-24 10:40:04.786311","last_peered":"2024-03-24 10:40:04.786311","last_clean":"2024-03-24 10:40:04.786311","last_became_active":"2024-03-24 10:40:04.466361","last_became_peered":"2024-03-24 10:40:04.466361","last_unstale":"2024-03-24 10:40:04.786311","last_undegraded":"2024-03-24 10:40:04.786311","last_fullsized":"2024-03-24 10:40:04.786311","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822276","last_change":"2024-03-24 10:40:04.813182","last_active":"2024-03-24 10:40:04.822276","last_peered":"2024-03-24 10:40:04.822276","last_clean":"2024-03-24 10:40:04.822276","last_became_active":"2024-03-24 10:40:04.812913","last_became_peered":"2024-03-24 10:40:04.812913","last_unstale":"2024-03-24 10:40:04.822276","last_undegraded":"2024-03-24 10:40:04.822276","last_fullsized":"2024-03-24 10:40:04.822276","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822519","last_change":"2024-03-24 10:40:04.471433","last_active":"2024-03-24 10:40:04.822519","last_peered":"2024-03-24 10:40:04.822519","last_clean":"2024-03-24 10:40:04.822519","last_became_active":"2024-03-24 10:40:04.470642","last_became_peered":"2024-03-24 10:40:04.470642","last_unstale":"2024-03-24 10:40:04.822519","last_undegraded":"2024-03-24 10:40:04.822519","last_fullsized":"2024-03-24 10:40:04.822519","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.800362","last_change":"2024-03-24 10:40:04.797400","last_active":"2024-03-24 10:40:04.800362","last_peered":"2024-03-24 10:40:04.800362","last_clean":"2024-03-24 10:40:04.800362","last_became_active":"2024-03-24 10:40:04.796948","last_became_peered":"2024-03-24 10:40:04.796948","last_unstale":"2024-03-24 10:40:04.800362","last_undegraded":"2024-03-24 10:40:04.800362","last_fullsized":"2024-03-24 10:40:04.800362","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822570","last_change":"2024-03-24 10:40:04.469692","last_active":"2024-03-24 10:40:04.822570","last_peered":"2024-03-24 10:40:04.822570","last_clean":"2024-03-24 10:40:04.822570","last_became_active":"2024-03-24 10:40:04.469341","last_became_peered":"2024-03-24 10:40:04.469341","last_unstale":"2024-03-24 10:40:04.822570","last_undegraded":"2024-03-24 10:40:04.822570","last_fullsized":"2024-03-24 10:40:04.822570","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821522","last_change":"2024-03-24 10:40:04.817078","last_active":"2024-03-24 10:40:04.821522","last_peered":"2024-03-24 10:40:04.821522","last_clean":"2024-03-24 10:40:04.821522","last_became_active":"2024-03-24 10:40:04.814972","last_became_peered":"2024-03-24 10:40:04.814972","last_unstale":"2024-03-24 10:40:04.821522","last_undegraded":"2024-03-24 10:40:04.821522","last_fullsized":"2024-03-24 10:40:04.821522","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821024","last_change":"2024-03-24 10:40:04.462402","last_active":"2024-03-24 10:40:04.821024","last_peered":"2024-03-24 10:40:04.821024","last_clean":"2024-03-24 10:40:04.821024","last_became_active":"2024-03-24 10:40:04.462086","last_became_peered":"2024-03-24 10:40:04.462086","last_unstale":"2024-03-24 10:40:04.821024","last_undegraded":"2024-03-24 10:40:04.821024","last_fullsized":"2024-03-24 10:40:04.821024","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.821333","last_change":"2024-03-24 10:40:04.817063","last_active":"2024-03-24 10:40:04.821333","last_peered":"2024-03-24 10:40:04.821333","last_clean":"2024-03-24 10:40:04.821333","last_became_active":"2024-03-24 10:40:04.816828","last_became_peered":"2024-03-24 10:40:04.816828","last_unstale":"2024-03-24 10:40:04.821333","last_undegraded":"2024-03-24 10:40:04.821333","last_fullsized":"2024-03-24 10:40:04.821333","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786369","last_change":"2024-03-24 10:40:04.475501","last_active":"2024-03-24 10:40:04.786369","last_peered":"2024-03-24 10:40:04.786369","last_clean":"2024-03-24 10:40:04.786369","last_became_active":"2024-03-24 10:40:04.474488","last_became_peered":"2024-03-24 10:40:04.474488","last_unstale":"2024-03-24 10:40:04.786369","last_undegraded":"2024-03-24 10:40:04.786369","last_fullsized":"2024-03-24 10:40:04.786369","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.807482","last_change":"2024-03-24 10:40:04.798123","last_active":"2024-03-24 10:40:04.807482","last_peered":"2024-03-24 10:40:04.807482","last_clean":"2024-03-24 10:40:04.807482","last_became_active":"2024-03-24 10:40:04.797813","last_became_peered":"2024-03-24 10:40:04.797813","last_unstale":"2024-03-24 10:40:04.807482","last_undegraded":"2024-03-24 10:40:04.807482","last_fullsized":"2024-03-24 10:40:04.807482","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794941","last_change":"2024-03-24 10:40:04.466188","last_active":"2024-03-24 10:40:04.794941","last_peered":"2024-03-24 10:40:04.794941","last_clean":"2024-03-24 10:40:04.794941","last_became_active":"2024-03-24 10:40:04.465874","last_became_peered":"2024-03-24 10:40:04.465874","last_unstale":"2024-03-24 10:40:04.794941","last_undegraded":"2024-03-24 10:40:04.794941","last_fullsized":"2024-03-24 10:40:04.794941","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.809380","last_change":"2024-03-24 10:40:04.798193","last_active":"2024-03-24 10:40:04.809380","last_peered":"2024-03-24 10:40:04.809380","last_clean":"2024-03-24 10:40:04.809380","last_became_active":"2024-03-24 10:40:04.797789","last_became_peered":"2024-03-24 10:40:04.797789","last_unstale":"2024-03-24 10:40:04.809380","last_undegraded":"2024-03-24 10:40:04.809380","last_fullsized":"2024-03-24 10:40:04.809380","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815947","last_change":"2024-03-24 10:40:04.468761","last_active":"2024-03-24 10:40:04.815947","last_peered":"2024-03-24 10:40:04.815947","last_clean":"2024-03-24 10:40:04.815947","last_became_active":"2024-03-24 10:40:04.468433","last_became_peered":"2024-03-24 10:40:04.468433","last_unstale":"2024-03-24 10:40:04.815947","last_undegraded":"2024-03-24 10:40:04.815947","last_fullsized":"2024-03-24 10:40:04.815947","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.810423","last_change":"2024-03-24 10:40:04.804326","last_active":"2024-03-24 10:40:04.810423","last_peered":"2024-03-24 10:40:04.810423","last_clean":"2024-03-24 10:40:04.810423","last_became_active":"2024-03-24 10:40:04.803241","last_became_peered":"2024-03-24 10:40:04.803241","last_unstale":"2024-03-24 10:40:04.810423","last_undegraded":"2024-03-24 10:40:04.810423","last_fullsized":"2024-03-24 10:40:04.810423","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.793860","last_change":"2024-03-24 10:40:04.449305","last_active":"2024-03-24 10:40:04.793860","last_peered":"2024-03-24 10:40:04.793860","last_clean":"2024-03-24 10:40:04.793860","last_became_active":"2024-03-24 10:40:04.447224","last_became_peered":"2024-03-24 10:40:04.447224","last_unstale":"2024-03-24 10:40:04.793860","last_undegraded":"2024-03-24 10:40:04.793860","last_fullsized":"2024-03-24 10:40:04.793860","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.806995","last_change":"2024-03-24 10:40:04.792127","last_active":"2024-03-24 10:40:04.806995","last_peered":"2024-03-24 10:40:04.806995","last_clean":"2024-03-24 10:40:04.806995","last_became_active":"2024-03-24 10:40:04.791834","last_became_peered":"2024-03-24 10:40:04.791834","last_unstale":"2024-03-24 10:40:04.806995","last_undegraded":"2024-03-24 10:40:04.806995","last_fullsized":"2024-03-24 10:40:04.806995","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792800","last_change":"2024-03-24 10:40:04.469939","last_active":"2024-03-24 10:40:04.792800","last_peered":"2024-03-24 10:40:04.792800","last_clean":"2024-03-24 10:40:04.792800","last_became_active":"2024-03-24 10:40:04.469602","last_became_peered":"2024-03-24 10:40:04.469602","last_unstale":"2024-03-24 10:40:04.792800","last_undegraded":"2024-03-24 10:40:04.792800","last_fullsized":"2024-03-24 10:40:04.792800","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.813550","last_change":"2024-03-24 10:40:04.800607","last_active":"2024-03-24 10:40:04.813550","last_peered":"2024-03-24 10:40:04.813550","last_clean":"2024-03-24 10:40:04.813550","last_became_active":"2024-03-24 10:40:04.799876","last_became_peered":"2024-03-24 10:40:04.799876","last_unstale":"2024-03-24 10:40:04.813550","last_undegraded":"2024-03-24 10:40:04.813550","last_fullsized":"2024-03-24 10:40:04.813550","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.784660","last_change":"2024-03-24 10:40:04.471630","last_active":"2024-03-24 10:40:04.784660","last_peered":"2024-03-24 10:40:04.784660","last_clean":"2024-03-24 10:40:04.784660","last_became_active":"2024-03-24 10:40:04.470859","last_became_peered":"2024-03-24 10:40:04.470859","last_unstale":"2024-03-24 10:40:04.784660","last_undegraded":"2024-03-24 10:40:04.784660","last_fullsized":"2024-03-24 10:40:04.784660","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799253","last_change":"2024-03-24 10:40:04.793642","last_active":"2024-03-24 10:40:04.799253","last_peered":"2024-03-24 10:40:04.799253","last_clean":"2024-03-24 10:40:04.799253","last_became_active":"2024-03-24 10:40:04.793294","last_became_peered":"2024-03-24 10:40:04.793294","last_unstale":"2024-03-24 10:40:04.799253","last_undegraded":"2024-03-24 10:40:04.799253","last_fullsized":"2024-03-24 10:40:04.799253","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.784768","last_change":"2024-03-24 10:40:04.471826","last_active":"2024-03-24 10:40:04.784768","last_peered":"2024-03-24 10:40:04.784768","last_clean":"2024-03-24 10:40:04.784768","last_became_active":"2024-03-24 10:40:04.471076","last_became_peered":"2024-03-24 10:40:04.471076","last_unstale":"2024-03-24 10:40:04.784768","last_undegraded":"2024-03-24 10:40:04.784768","last_fullsized":"2024-03-24 10:40:04.784768","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794016","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:40:04.794016","last_peered":"2024-03-24 10:40:04.794016","last_clean":"2024-03-24 10:40:04.794016","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:04.794016","last_undegraded":"2024-03-24 10:40:04.794016","last_fullsized":"2024-03-24 10:40:04.794016","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822594","last_change":"2024-03-24 10:40:04.814681","last_active":"2024-03-24 10:40:04.822594","last_peered":"2024-03-24 10:40:04.822594","last_clean":"2024-03-24 10:40:04.822594","last_became_active":"2024-03-24 10:40:04.814388","last_became_peered":"2024-03-24 10:40:04.814388","last_unstale":"2024-03-24 10:40:04.822594","last_undegraded":"2024-03-24 10:40:04.822594","last_fullsized":"2024-03-24 10:40:04.822594","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.790650","last_change":"2024-03-24 10:40:04.447613","last_active":"2024-03-24 10:40:04.790650","last_peered":"2024-03-24 10:40:04.790650","last_clean":"2024-03-24 10:40:04.790650","last_became_active":"2024-03-24 10:40:04.447203","last_became_peered":"2024-03-24 10:40:04.447203","last_unstale":"2024-03-24 10:40:04.790650","last_undegraded":"2024-03-24 10:40:04.790650","last_fullsized":"2024-03-24 10:40:04.790650","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785470","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:40:04.785470","last_peered":"2024-03-24 10:40:04.785470","last_clean":"2024-03-24 10:40:04.785470","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:04.785470","last_undegraded":"2024-03-24 10:40:04.785470","last_fullsized":"2024-03-24 10:40:04.785470","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.822265","last_change":"2024-03-24 10:40:04.812811","last_active":"2024-03-24 10:40:04.822265","last_peered":"2024-03-24 10:40:04.822265","last_clean":"2024-03-24 10:40:04.822265","last_became_active":"2024-03-24 10:40:04.812343","last_became_peered":"2024-03-24 10:40:04.812343","last_unstale":"2024-03-24 10:40:04.822265","last_undegraded":"2024-03-24 10:40:04.822265","last_fullsized":"2024-03-24 10:40:04.822265","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799087","last_change":"2024-03-24 10:40:04.459751","last_active":"2024-03-24 10:40:04.799087","last_peered":"2024-03-24 10:40:04.799087","last_clean":"2024-03-24 10:40:04.799087","last_became_active":"2024-03-24 10:40:04.459255","last_became_peered":"2024-03-24 10:40:04.459255","last_unstale":"2024-03-24 10:40:04.799087","last_undegraded":"2024-03-24 10:40:04.799087","last_fullsized":"2024-03-24 10:40:04.799087","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.783985","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:04.783985","last_peered":"2024-03-24 10:40:04.783985","last_clean":"2024-03-24 10:40:04.783985","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:04.783985","last_undegraded":"2024-03-24 10:40:04.783985","last_fullsized":"2024-03-24 10:40:04.783985","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.807370","last_change":"2024-03-24 10:40:04.795447","last_active":"2024-03-24 10:40:04.807370","last_peered":"2024-03-24 10:40:04.807370","last_clean":"2024-03-24 10:40:04.807370","last_became_active":"2024-03-24 10:40:04.795157","last_became_peered":"2024-03-24 10:40:04.795157","last_unstale":"2024-03-24 10:40:04.807370","last_undegraded":"2024-03-24 10:40:04.807370","last_fullsized":"2024-03-24 10:40:04.807370","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.817435","last_change":"2024-03-24 10:40:04.458550","last_active":"2024-03-24 10:40:04.817435","last_peered":"2024-03-24 10:40:04.817435","last_clean":"2024-03-24 10:40:04.817435","last_became_active":"2024-03-24 10:40:04.458240","last_became_peered":"2024-03-24 10:40:04.458240","last_unstale":"2024-03-24 10:40:04.817435","last_undegraded":"2024-03-24 10:40:04.817435","last_fullsized":"2024-03-24 10:40:04.817435","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791506","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:04.791506","last_peered":"2024-03-24 10:40:04.791506","last_clean":"2024-03-24 10:40:04.791506","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:04.791506","last_undegraded":"2024-03-24 10:40:04.791506","last_fullsized":"2024-03-24 10:40:04.791506","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.818766","last_change":"2024-03-24 10:40:04.810786","last_active":"2024-03-24 10:40:04.818766","last_peered":"2024-03-24 10:40:04.818766","last_clean":"2024-03-24 10:40:04.818766","last_became_active":"2024-03-24 10:40:04.810455","last_became_peered":"2024-03-24 10:40:04.810455","last_unstale":"2024-03-24 10:40:04.818766","last_undegraded":"2024-03-24 10:40:04.818766","last_fullsized":"2024-03-24 10:40:04.818766","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786422","last_change":"2024-03-24 10:40:04.475698","last_active":"2024-03-24 10:40:04.786422","last_peered":"2024-03-24 10:40:04.786422","last_clean":"2024-03-24 10:40:04.786422","last_became_active":"2024-03-24 10:40:04.475190","last_became_peered":"2024-03-24 10:40:04.475190","last_unstale":"2024-03-24 10:40:04.786422","last_undegraded":"2024-03-24 10:40:04.786422","last_fullsized":"2024-03-24 10:40:04.786422","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792326","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:04.792326","last_peered":"2024-03-24 10:40:04.792326","last_clean":"2024-03-24 10:40:04.792326","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:04.792326","last_undegraded":"2024-03-24 10:40:04.792326","last_fullsized":"2024-03-24 10:40:04.792326","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.811059","last_change":"2024-03-24 10:40:04.801128","last_active":"2024-03-24 10:40:04.811059","last_peered":"2024-03-24 10:40:04.811059","last_clean":"2024-03-24 10:40:04.811059","last_became_active":"2024-03-24 10:40:04.800850","last_became_peered":"2024-03-24 10:40:04.800850","last_unstale":"2024-03-24 10:40:04.811059","last_undegraded":"2024-03-24 10:40:04.811059","last_fullsized":"2024-03-24 10:40:04.811059","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791345","last_change":"2024-03-24 10:40:04.470413","last_active":"2024-03-24 10:40:04.791345","last_peered":"2024-03-24 10:40:04.791345","last_clean":"2024-03-24 10:40:04.791345","last_became_active":"2024-03-24 10:40:04.470060","last_became_peered":"2024-03-24 10:40:04.470060","last_unstale":"2024-03-24 10:40:04.791345","last_undegraded":"2024-03-24 10:40:04.791345","last_fullsized":"2024-03-24 10:40:04.791345","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786388","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:40:04.786388","last_peered":"2024-03-24 10:40:04.786388","last_clean":"2024-03-24 10:40:04.786388","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:04.786388","last_undegraded":"2024-03-24 10:40:04.786388","last_fullsized":"2024-03-24 10:40:04.786388","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.815343","last_change":"2024-03-24 10:40:04.807905","last_active":"2024-03-24 10:40:04.815343","last_peered":"2024-03-24 10:40:04.815343","last_clean":"2024-03-24 10:40:04.815343","last_became_active":"2024-03-24 10:40:04.807627","last_became_peered":"2024-03-24 10:40:04.807627","last_unstale":"2024-03-24 10:40:04.815343","last_undegraded":"2024-03-24 10:40:04.815343","last_fullsized":"2024-03-24 10:40:04.815343","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792282","last_change":"2024-03-24 10:40:04.461325","last_active":"2024-03-24 10:40:04.792282","last_peered":"2024-03-24 10:40:04.792282","last_clean":"2024-03-24 10:40:04.792282","last_became_active":"2024-03-24 10:40:04.461012","last_became_peered":"2024-03-24 10:40:04.461012","last_unstale":"2024-03-24 10:40:04.792282","last_undegraded":"2024-03-24 10:40:04.792282","last_fullsized":"2024-03-24 10:40:04.792282","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786255","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:04.786255","last_peered":"2024-03-24 10:40:04.786255","last_clean":"2024-03-24 10:40:04.786255","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:04.786255","last_undegraded":"2024-03-24 10:40:04.786255","last_fullsized":"2024-03-24 10:40:04.786255","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.807351","last_change":"2024-03-24 10:40:04.793392","last_active":"2024-03-24 10:40:04.807351","last_peered":"2024-03-24 10:40:04.807351","last_clean":"2024-03-24 10:40:04.807351","last_became_active":"2024-03-24 10:40:04.793092","last_became_peered":"2024-03-24 10:40:04.793092","last_unstale":"2024-03-24 10:40:04.807351","last_undegraded":"2024-03-24 10:40:04.807351","last_fullsized":"2024-03-24 10:40:04.807351","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:04.429389","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:04.429389","last_clean_scrub_stamp":"2024-03-24 10:40:04.429389","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.784388","last_change":"2024-03-24 10:40:04.468002","last_active":"2024-03-24 10:40:04.784388","last_peered":"2024-03-24 10:40:04.784388","last_clean":"2024-03-24 10:40:04.784388","last_became_active":"2024-03-24 10:40:04.467670","last_became_peered":"2024-03-24 10:40:04.467670","last_unstale":"2024-03-24 10:40:04.784388","last_undegraded":"2024-03-24 10:40:04.784388","last_fullsized":"2024-03-24 10:40:04.784388","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:03.425851","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:03.425851","last_clean_scrub_stamp":"2024-03-24 10:40:03.425851","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799312","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:04.799312","last_peered":"2024-03-24 10:40:04.799312","last_clean":"2024-03-24 10:40:04.799312","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:04.799312","last_undegraded":"2024-03-24 10:40:04.799312","last_fullsized":"2024-03-24 10:40:04.799312","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705678,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":72360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705679,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":71614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":70164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705679,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":70730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.249}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.28399999999999997}]}]}]}} 2024-03-24T10:40:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-24T10:40:12.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.406 7fc3a8807700 1 Processor -- start 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.406 7fc3a8807700 1 -- start start 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a8807700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 0x7fc3a41a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a8807700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 0x7fc3a41a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a8807700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a410cf10 con 0x7fc3a40f58a0 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a8807700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40fa210 con 0x7fc3a41a6b60 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a8807700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40f9540 con 0x7fc3a410cac0 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a15fb700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc3a40f58a0 0x7fc3a410c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41836/0 (socket says 172.21.15.73:41836) 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a15fb700 1 -- 172.21.15.73:0/523270471 learned_addr learned my addr 172.21.15.73:0/523270471 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 0x7fc3a41a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a0dfa700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 0x7fc3a41a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc393fff700 1 -- 172.21.15.73:0/523270471 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694339527 0 0) 0x7fc398001110 con 0x7fc3a40f58a0 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 -- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 msgr2=0x7fc3a41a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 0x7fc3a41a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 -- 172.21.15.73:0/523270471 >> v1:172.21.15.73:6789/0 conn(0x7fc3a40f58a0 legacy=0x7fc3a410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 -- 172.21.15.73:0/523270471 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a41aa600 con 0x7fc3a41a6b60 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a0dfa700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 0x7fc3a41a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc3a1dfc700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 0x7fc3a41a8fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3a4113380 tx=0x7fc39c009d70).ready entity=mon.1 client_cookie=77d5c1dd060025c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc393fff700 1 -- 172.21.15.73:0/523270471 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3a41aa600 con 0x7fc3a41a6b60 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc393fff700 1 -- 172.21.15.73:0/523270471 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00b7c0 con 0x7fc3a41a6b60 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.407 7fc393fff700 1 -- 172.21.15.73:0/523270471 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc39c00b9a0 con 0x7fc3a41a6b60 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 -- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 msgr2=0x7fc3a41a8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 0x7fc3a41a8fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3a4113380 tx=0x7fc39c009d70).stop 2024-03-24T10:40:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 -- 172.21.15.73:0/523270471 shutdown_connections 2024-03-24T10:40:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a6b60 0x7fc3a41a8fc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 --2- 172.21.15.73:0/523270471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a410cac0 0x7fc3a41a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 -- 172.21.15.73:0/523270471 >> 172.21.15.73:0/523270471 conn(0x7fc3a41139f0 msgr2=0x7fc3a40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 -- 172.21.15.73:0/523270471 shutdown_connections 2024-03-24T10:40:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.408 7fc3a8807700 1 -- 172.21.15.73:0/523270471 wait complete. 2024-03-24T10:40:12.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 Processor -- start 2024-03-24T10:40:12.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 -- start start 2024-03-24T10:40:12.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 0x7fc3a41a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 0x7fc3a41b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40dbb50 con 0x7fc3a40c79f0 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40c8140 con 0x7fc3a41a9f80 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a8807700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41b0a80 con 0x7fc3a41a9b30 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a15fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 0x7fc3a41a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a0dfa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a1dfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 0x7fc3a41b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a0dfa700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42498/0 (socket says 172.21.15.73:42498) 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a15fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 0x7fc3a41a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55442/0 (socket says 172.21.15.73:55442) 2024-03-24T10:40:12.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a1dfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 0x7fc3a41b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60172/0 (socket says 172.21.15.73:60172) 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.431 7fc3a0dfa700 1 -- 172.21.15.73:0/123332543 learned_addr learned my addr 172.21.15.73:0/123332543 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 -- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 msgr2=0x7fc3a41b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 0x7fc3a41b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 -- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 msgr2=0x7fc3a41a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 0x7fc3a41a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 -- 172.21.15.73:0/123332543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a41b0cb0 con 0x7fc3a41a9b30 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a0dfa700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc394010000 tx=0x7fc394012f70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3a41b0cb0 con 0x7fc3a41a9b30 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394014040 con 0x7fc3a41a9b30 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a8807700 1 -- 172.21.15.73:0/123332543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a41b7620 con 0x7fc3a41a9b30 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc394010a20 con 0x7fc3a41a9b30 2024-03-24T10:40:12.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.432 7fc3a8807700 1 -- 172.21.15.73:0/123332543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a41b7a00 con 0x7fc3a41a9b30 2024-03-24T10:40:12.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.433 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc394010c20 con 0x7fc3a41a9b30 2024-03-24T10:40:12.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.433 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc394001bc0 con 0x7fc3a41a9b30 2024-03-24T10:40:12.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.433 7fc3a8807700 1 -- 172.21.15.73:0/123332543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a40f0860 con 0x7fc3a41a9b30 2024-03-24T10:40:12.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.437 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc39400d0d0 con 0x7fc3a41a9b30 2024-03-24T10:40:12.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.573 7fc3a8807700 1 -- 172.21.15.73:0/123332543 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc3a41aa540 con 0x7fc3a41a9b30 2024-03-24T10:40:12.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.577 7fc3927fc700 1 -- 172.21.15.73:0/123332543 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc394000c30 con 0x7fc3a41a9b30 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 >> v1:172.21.15.73:6816/43277 conn(0x7fc3800145b0 legacy=0x7fc380016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 msgr2=0x7fc3a41afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc394010000 tx=0x7fc394012f70).stop 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 shutdown_connections 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3a41a9f80 0x7fc3a41b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3a40c79f0 0x7fc3a41a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 --2- 172.21.15.73:0/123332543 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fc3a41a9b30 0x7fc3a41afe20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 >> 172.21.15.73:0/123332543 conn(0x7fc3a40e1080 msgr2=0x7fc3a40de730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 shutdown_connections 2024-03-24T10:40:12.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.578 7fc3a8807700 1 -- 172.21.15.73:0/123332543 wait complete. 2024-03-24T10:40:12.580 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-03-24T10:40:12.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.715 7f10aac66700 1 Processor -- start 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.715 7f10aac66700 1 -- start start 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10aac66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 0x7f10a410e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10aac66700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 0x7f10a40f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10aac66700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40f1e30 con 0x7f10a410ea90 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10aac66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40fb670 con 0x7f10a4106530 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10aac66700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4106980 con 0x7f10a410eee0 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 0x7f10a410e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 0x7f10a40f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a2ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10a410ea90 0x7f10a40f1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41848/0 (socket says 172.21.15.73:41848) 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a2ffd700 1 -- 172.21.15.73:0/1132154119 learned_addr learned my addr 172.21.15.73:0/1132154119 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 -- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 msgr2=0x7f10a410e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 0x7f10a410e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a27fc700 1 -- 172.21.15.73:0/1132154119 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211395874 0 0) 0x7f1094001110 con 0x7f10a410ea90 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 -- 172.21.15.73:0/1132154119 >> v1:172.21.15.73:6789/0 conn(0x7f10a410ea90 legacy=0x7f10a40f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 -- 172.21.15.73:0/1132154119 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a41ac7c0 con 0x7f10a410eee0 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a37fe700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 0x7f10a410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.716 7f10a3fff700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 0x7f10a40f1800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f10a40f5980 tx=0x7f109c009cf0).ready entity=mon.2 client_cookie=f4a3c1f9039c4a0d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10a27fc700 1 -- 172.21.15.73:0/1132154119 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10a41ac7c0 con 0x7f10a410eee0 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10a27fc700 1 -- 172.21.15.73:0/1132154119 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00b840 con 0x7f10a410eee0 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10a27fc700 1 -- 172.21.15.73:0/1132154119 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f109c00ba20 con 0x7f10a410eee0 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 -- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 msgr2=0x7f10a40f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 0x7f10a40f1800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f10a40f5980 tx=0x7f109c009cf0).stop 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 -- 172.21.15.73:0/1132154119 shutdown_connections 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a410eee0 0x7f10a40f1800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 --2- 172.21.15.73:0/1132154119 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a4106530 0x7f10a410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 -- 172.21.15.73:0/1132154119 >> 172.21.15.73:0/1132154119 conn(0x7f10a4114940 msgr2=0x7f10a4114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 -- 172.21.15.73:0/1132154119 shutdown_connections 2024-03-24T10:40:12.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.717 7f10aac66700 1 -- 172.21.15.73:0/1132154119 wait complete. 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.740 7f10aac66700 1 Processor -- start 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.740 7f10aac66700 1 -- start start 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 0x7f10a41b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 0x7f10a41b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40e0550 con 0x7f10a41ac420 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40c4ca0 con 0x7f10a41b4db0 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40d4550 con 0x7f10a41ab9a0 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 0x7f10a41b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42526/0 (socket says 172.21.15.73:42526) 2024-03-24T10:40:12.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a37fe700 1 -- 172.21.15.73:0/3841379190 learned_addr learned my addr 172.21.15.73:0/3841379190 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a3fff700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 0x7f10a41b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 -- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 msgr2=0x7f10a41abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 -- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 msgr2=0x7f10a41b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 0x7f10a41b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 -- 172.21.15.73:0/3841379190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40d3f00 con 0x7f10a41ac420 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a37fe700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a3fff700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 0x7f10a41b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a2ffd700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 0x7f10a41b4780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f10a40d6f90 tx=0x7f109400c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10a40d3f00 con 0x7f10a41ac420 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940070d0 con 0x7f10a41ac420 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.741 7f10aac66700 1 -- 172.21.15.73:0/3841379190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a41bbe70 con 0x7f10a41ac420 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.742 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1094005620 con 0x7f10a41ac420 2024-03-24T10:40:12.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.742 7f10aac66700 1 -- 172.21.15.73:0/3841379190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41bc250 con 0x7f10a41ac420 2024-03-24T10:40:12.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.742 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1094005820 con 0x7f10a41ac420 2024-03-24T10:40:12.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.742 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f10940146a0 con 0x7f10a41ac420 2024-03-24T10:40:12.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.743 7f10aac66700 1 -- 172.21.15.73:0/3841379190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a40f08e0 con 0x7f10a41ac420 2024-03-24T10:40:12.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.746 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f109400cda0 con 0x7f10a41ac420 2024-03-24T10:40:12.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.882 7f10aac66700 1 -- 172.21.15.73:0/3841379190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10a41aeea0 con 0x7f10a41ac420 2024-03-24T10:40:12.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.883 7f10a0ff9700 1 -- 172.21.15.73:0/3841379190 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7f1094000c30 con 0x7f10a41ac420 2024-03-24T10:40:12.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:12.883 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 >> v1:172.21.15.73:6816/43277 conn(0x7f10840145b0 legacy=0x7f1084016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 msgr2=0x7f10a41b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 0x7f10a41b4780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f10a40d6f90 tx=0x7f109400c830).stop 2024-03-24T10:40:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 shutdown_connections 2024-03-24T10:40:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10a41b4db0 0x7f10a41b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f10a41ab9a0 0x7f10a41abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 --2- 172.21.15.73:0/3841379190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a41ac420 0x7f10a41b4780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 >> 172.21.15.73:0/3841379190 conn(0x7f10a40cfc70 msgr2=0x7f10a40d73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 shutdown_connections 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:12.884 7f10aac66700 1 -- 172.21.15.73:0/3841379190 wait complete. 2024-03-24T10:40:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:12.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-24 10:40:04.777574', 'modified': '2024-03-24 10:40:06.781227', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4980}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4980': {'gid': 4980, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6817/3503607711', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.73:6817', 'nonce': 3503607711}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-24T10:40:12.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-24T10:40:12.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-24T10:40:13.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 Processor -- start 2024-03-24T10:40:13.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 -- start start 2024-03-24T10:40:13.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74240f5a00 0x7f742410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f742410b730 0x7f742419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74241a0a60 con 0x7f742410bb80 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74240fa580 con 0x7f74240f5a00 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f742a531700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74241a0c80 con 0x7f742410b730 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f74232c1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74240f5a00 0x7f742410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f7423ac2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f742410bb80 0x7f74241a0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41854/0 (socket says 172.21.15.73:41854) 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f7423ac2700 1 -- 172.21.15.73:0/3025286644 learned_addr learned my addr 172.21.15.73:0/3025286644 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f7422ac0700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f742410b730 0x7f742419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f74232c1700 1 -- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f742410b730 msgr2=0x7f742419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.122 7f74232c1700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f742410b730 0x7f742419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74232c1700 1 -- 172.21.15.73:0/3025286644 >> v1:172.21.15.73:6789/0 conn(0x7f742410bb80 legacy=0x7f74241a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74222bf700 1 -- 172.21.15.73:0/3025286644 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410975484 0 0) 0x7f741c001490 con 0x7f742410bb80 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74232c1700 1 -- 172.21.15.73:0/3025286644 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74241a93c0 con 0x7f74240f5a00 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74232c1700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240f5a00 0x7f742410b100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f742410f910 tx=0x7f741400ba20).ready entity=mon.0 client_cookie=7ea165223169ad9c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74222bf700 1 -- 172.21.15.73:0/3025286644 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74241a93c0 con 0x7f74240f5a00 2024-03-24T10:40:13.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74222bf700 1 -- 172.21.15.73:0/3025286644 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400d5c0 con 0x7f74240f5a00 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f74222bf700 1 -- 172.21.15.73:0/3025286644 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f741400d990 con 0x7f74240f5a00 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 -- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240f5a00 msgr2=0x7f742410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240f5a00 0x7f742410b100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f742410f910 tx=0x7f741400ba20).stop 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 -- 172.21.15.73:0/3025286644 shutdown_connections 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240f5a00 0x7f742410b100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 --2- 172.21.15.73:0/3025286644 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f742410b730 0x7f742419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 -- 172.21.15.73:0/3025286644 >> 172.21.15.73:0/3025286644 conn(0x7f7424113a60 msgr2=0x7f74240f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 -- 172.21.15.73:0/3025286644 shutdown_connections 2024-03-24T10:40:13.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.123 7f742a531700 1 -- 172.21.15.73:0/3025286644 wait complete. 2024-03-24T10:40:13.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 Processor -- start 2024-03-24T10:40:13.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 -- start start 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 0x7f74240d6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 0x7f74241b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240a83c0 con 0x7f74240d5b10 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240c3670 con 0x7f74240d6e40 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f742a531700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74240dbcf0 con 0x7f74240d5090 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f74232c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f7423ac2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 0x7f74241b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f74232c1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42546/0 (socket says 172.21.15.73:42546) 2024-03-24T10:40:13.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f74232c1700 1 -- 172.21.15.73:0/3995909040 learned_addr learned my addr 172.21.15.73:0/3995909040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.146 7f7422ac0700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 0x7f74240d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 -- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 msgr2=0x7f74241b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 0x7f74241b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 -- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 msgr2=0x7f74240d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 0x7f74240d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 -- 172.21.15.73:0/3995909040 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240d7290 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f7422ac0700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 0x7f74240d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f7423ac2700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 0x7f74241b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f74232c1700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f74240c3c30 tx=0x7f74140068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f7420abc700 1 -- 172.21.15.73:0/3995909040 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74240d7290 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f7420abc700 1 -- 172.21.15.73:0/3995909040 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74140119d0 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f742a531700 1 -- 172.21.15.73:0/3995909040 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74240d7550 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f7420abc700 1 -- 172.21.15.73:0/3995909040 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7414022070 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.147 7f742a531700 1 -- 172.21.15.73:0/3995909040 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74241b7df0 con 0x7f74240d5090 2024-03-24T10:40:13.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.148 7f7420abc700 1 -- 172.21.15.73:0/3995909040 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7414026410 con 0x7f74240d5090 2024-03-24T10:40:13.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.148 7f7420abc700 1 -- 172.21.15.73:0/3995909040 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7414009770 con 0x7f74240d5090 2024-03-24T10:40:13.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.150 7f743cdeab80 1 Processor -- start 2024-03-24T10:40:13.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.150 7f743cdeab80 1 -- start start 2024-03-24T10:40:13.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 0x55b8247e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8247e8f10 0x55b8247e9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b824720c80 con 0x55b8247e8f10 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b82473ea40 con 0x55b8247f5220 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b82470be00 con 0x55b8247f5ca0 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60208/0 (socket says 172.21.15.73:60208) 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f7423ac2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8247e8f10 0x55b8247e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 -- 172.21.15.73:0/3483254365 learned_addr learned my addr 172.21.15.73:0/3483254365 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f7422ac0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 0x55b8247e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 -- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 msgr2=0x55b8247e88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 0x55b8247e88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 -- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8247e8f10 msgr2=0x55b8247e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8247e8f10 0x55b8247e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 -- 172.21.15.73:0/3483254365 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8247be3a0 con 0x55b8247f5220 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f7422ac0700 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 0x55b8247e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f74232c1700 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x55b8247e8810 tx=0x7f741400ba20).ready entity=mon.1 client_cookie=d30aa59573d2c6ae server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f742a531700 1 -- 172.21.15.73:0/3483254365 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b8247be3a0 con 0x55b8247f5220 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f742a531700 1 -- 172.21.15.73:0/3483254365 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741402b060 con 0x55b8247f5220 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f742a531700 1 -- 172.21.15.73:0/3483254365 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74241b7df0 con 0x55b8247f5220 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 -- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 msgr2=0x55b8247f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.151 7f743cdeab80 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x55b8247e8810 tx=0x7f741400ba20).stop 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 -- 172.21.15.73:0/3483254365 shutdown_connections 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8247e8f10 0x55b8247e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b8247f5220 0x55b8247f5670 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 --2- 172.21.15.73:0/3483254365 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b8247f5ca0 0x55b8247e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 -- 172.21.15.73:0/3483254365 >> 172.21.15.73:0/3483254365 conn(0x55b8247e1cc0 msgr2=0x55b824803200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 -- 172.21.15.73:0/3483254365 shutdown_connections 2024-03-24T10:40:13.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 -- 172.21.15.73:0/3483254365 wait complete. 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 -- start start 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.152 7f743cdeab80 1 Processor -- start 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 0x55b824810cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 0x55b824801030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b824801660 0x55b824817d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8247e3690 con 0x55b8248108a0 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8247e1500 con 0x55b824801660 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b8247f6200 con 0x55b824811320 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f743cdeab80 10 client.0 ll_register_callbacks cb 0x55b824716d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f74232c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 0x55b824810cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7423ac2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b824801660 0x55b824817d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f74232c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 0x55b824810cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55492/0 (socket says 172.21.15.73:55492) 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 0x55b824801030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f74232c1700 1 -- 172.21.15.73:0/3668413805 learned_addr learned my addr 172.21.15.73:0/3668413805 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 -- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b824801660 msgr2=0x55b824817d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b824801660 0x55b824817d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 -- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 msgr2=0x55b824810cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 0x55b824810cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 -- 172.21.15.73:0/3668413805 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b82462eb60 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f7422ac0700 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 0x55b824801030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55b8247e1180 tx=0x7f741800e840).ready entity=mon.2 client_cookie=c1276087fbcad5ee server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.153 7f73fe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3302/0 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b82462eb60 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mon.2 v2:172.21.15.73:3302/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f741801b430 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b824729cd0 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7f741801b6a0 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 10 client.4838 fetch_fsmap learned FSMap version 11 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55b8248038d0 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mon.2 v2:172.21.15.73:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b824729cd0 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mon.2 v2:172.21.15.73:3302/0 5 ==== fsmap(e 11) v1 ==== 1025+0+0 (secure 0 0 0) 0x7f7418028420 con 0x55b824811320 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 10 client.4838 fetch_fsmap finished waiting for FSMap version 11 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 10 client.4838 resolve_mds: resolved ID 'a' to GID 4980 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 20 client.4838 populate_metadata read hostname 'smithi073' 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 4 client.4838 mds_command: new command op to 4980 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-24T10:40:13.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 --> v1:172.21.15.73:6817/3503607711 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b824622ba0 con 0x55b8248186c0 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.154 7f73fe7fc700 10 client.4838 ms_handle_connect on v1:172.21.15.73:6817/3503607711 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f73fe7fc700 1 -- 172.21.15.73:0/3668413805 <== mds.0 v1:172.21.15.73:6817/3503607711 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55b824622ba0 con 0x55b8248186c0 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f73fe7fc700 10 client.4838 handle_command_reply: tid=0 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 client.4838 shutdown 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 msgr2=0x55b824801030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 0x55b824801030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55b8247e1180 tx=0x7f741800e840).stop 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 shutdown_connections 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b824801660 0x55b824817d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b8248108a0 0x55b824810cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f73fe7fc700 0 client.4838 ms_handle_reset on v1:172.21.15.73:6817/3503607711 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 --2- 172.21.15.73:0/3668413805 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x55b824811320 0x55b824801030 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 >> 172.21.15.73:0/3668413805 conn(0x55b8247e8850 msgr2=0x55b8247e8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 shutdown_connections 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 1 -- 172.21.15.73:0/3668413805 wait complete. 2024-03-24T10:40:13.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.155 7f743cdeab80 20 client.4838 trim_cache size 0 max 16384 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.164 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 >> v1:172.21.15.73:6816/43277 conn(0x7f74040145b0 legacy=0x7f7404016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.164 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 msgr2=0x7f74240d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.164 7f7408ca4700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f74240c3c30 tx=0x7f74140068c0).stop 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 shutdown_connections 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74240d6e40 0x7f74241b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f74240d5090 0x7f74240d54e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 --2- 172.21.15.73:0/3995909040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74240d5b10 0x7f74240d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 >> 172.21.15.73:0/3995909040 conn(0x7f74240c8e80 msgr2=0x7f74240c2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 shutdown_connections 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.165 7f7408ca4700 1 -- 172.21.15.73:0/3995909040 wait complete. 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:injectargs [...] 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:config set 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:config unset 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:exit 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:respawn 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:session kill 2024-03-24T10:40:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:cpu_profiler status|flush 2024-03-24T10:40:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:session ls { [...]} 2024-03-24T10:40:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:client ls { [...]} 2024-03-24T10:40:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:session evict { [...]} 2024-03-24T10:40:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:40:13.175 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:40:13.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:40:13.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 Processor -- start 2024-03-24T10:40:13.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 -- start start 2024-03-24T10:40:13.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b7c0f58a0 0x7f8b7c0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c0f91b0 con 0x7f8b7c0f2290 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c10f060 con 0x7f8b7c0f58a0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b82bf7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c1ac600 con 0x7f8b7c0f1e40 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b73fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b7b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b7c0f58a0 0x7f8b7c0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b7bfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8b7c0f2290 0x7f8b7c10e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41858/0 (socket says 172.21.15.73:41858) 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b7bfff700 1 -- 172.21.15.73:0/106559818 learned_addr learned my addr 172.21.15.73:0/106559818 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.301 7f8b73fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60222/0 (socket says 172.21.15.73:60222) 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7b7fe700 1 -- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 msgr2=0x7f8b7c10e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7b7fe700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7b7fe700 1 -- 172.21.15.73:0/106559818 >> v1:172.21.15.73:6789/0 conn(0x7f8b7c0f2290 legacy=0x7f8b7c10e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7b7fe700 1 -- 172.21.15.73:0/106559818 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c1ac7b0 con 0x7f8b7c0f58a0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b73fff700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7b7fe700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0f58a0 0x7f8b7c0f1810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8b6c002f70 tx=0x7f8b6c00b9f0).ready entity=mon.0 client_cookie=51925a41f87f3759 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7affd700 1 -- 172.21.15.73:0/106559818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b7c1ac7b0 con 0x7f8b7c0f58a0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7affd700 1 -- 172.21.15.73:0/106559818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00d5c0 con 0x7f8b7c0f58a0 2024-03-24T10:40:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b7affd700 1 -- 172.21.15.73:0/106559818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b6c00d9e0 con 0x7f8b7c0f58a0 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b82bf7700 1 -- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0f58a0 msgr2=0x7f8b7c0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.302 7f8b82bf7700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0f58a0 0x7f8b7c0f1810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8b6c002f70 tx=0x7f8b6c00b9f0).stop 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 -- 172.21.15.73:0/106559818 shutdown_connections 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0f58a0 0x7f8b7c0f1810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 --2- 172.21.15.73:0/106559818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0f1e40 0x7f8b7c10e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 -- 172.21.15.73:0/106559818 >> 172.21.15.73:0/106559818 conn(0x7f8b7c1139f0 msgr2=0x7f8b7c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 -- 172.21.15.73:0/106559818 shutdown_connections 2024-03-24T10:40:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.303 7f8b82bf7700 1 -- 172.21.15.73:0/106559818 wait complete. 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.325 7f8b82bf7700 1 Processor -- start 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.325 7f8b82bf7700 1 -- start start 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.325 7f8b82bf7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8b7c0c5190 0x7f8b7c0d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b82bf7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b82bf7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 0x7f8b7c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b82bf7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0d5090 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b82bf7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0d3e00 con 0x7f8b7c0d3640 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b82bf7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0cf050 con 0x7f8b7c0c5190 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b7b7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8b7c0c5190 0x7f8b7c0d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55508/0 (socket says 172.21.15.73:55508) 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 -- 172.21.15.73:0/218449462 learned_addr learned my addr 172.21.15.73:0/218449462 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b7bfff700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 0x7f8b7c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:13.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 -- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8b7c0c5190 msgr2=0x7f8b7c0d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8b7c0c5190 0x7f8b7c0d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 -- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 msgr2=0x7f8b7c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 0x7f8b7c0cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 -- 172.21.15.73:0/218449462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c1bb8b0 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b7bfff700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 0x7f8b7c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b73fff700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8b6400c000 tx=0x7f8b6400ec70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b7c1bb8b0 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6400c9a0 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.326 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8b6400f040 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.327 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c1bbab0 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.327 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c1bbe90 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.327 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8b64011070 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.327 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8b64010040 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.328 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c0f0860 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.331 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8b6400c5a0 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.465 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b7c1ae850 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.466 7f8b797fa700 1 -- 172.21.15.73:0/218449462 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8b64000c30 con 0x7f8b7c0d31f0 2024-03-24T10:40:13.466 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 >> v1:172.21.15.73:6816/43277 conn(0x7f8b600145b0 legacy=0x7f8b60016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 msgr2=0x7f8b7c0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8b6400c000 tx=0x7f8b6400ec70).stop 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 shutdown_connections 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8b7c0d3640 0x7f8b7c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f8b7c0c5190 0x7f8b7c0d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 --2- 172.21.15.73:0/218449462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b7c0d31f0 0x7f8b7c0ce3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:13.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 >> 172.21.15.73:0/218449462 conn(0x7f8b7c0c5af0 msgr2=0x7f8b7c0bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:13.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 shutdown_connections 2024-03-24T10:40:13.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:13.467 7f8b82bf7700 1 -- 172.21.15.73:0/218449462 wait complete. 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:40:13.478 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:40:13.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:13.479 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-03-24T10:40:13.528 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:40:13.528 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:40:13.529 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether a6:85:43:ec:70:ba brd ff:ff:ff:ff:ff:ff 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::d011:62ff:fea2:204c/64 scope link 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether a6:85:43:ec:70:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::a485:43ff:feec:70ba/64 scope link 2024-03-24T10:40:13.530 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:40:13.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:13.531 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:40:13.599 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-03-24T10:40:13.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:13.603 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-03-24T10:40:13.650 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-03-24T10:40:13.650 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:40:13.650 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:40:13.650 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:40:13.651 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:40:13.652 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-03-24T10:40:13.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:40:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:40:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:40:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:40:13.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:13.863 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-03-24T10:40:13.908 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-24T10:40:13.909 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:40:13.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:13.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-03-24T10:40:14.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:40:14.015 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-24T10:40:14.059 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:40:14.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:40:14.059 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:40:14.142 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-24T10:40:14.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:14.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:40:14.273 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:40:14.273 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-03-24T10:40:14.274 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-03-24T10:40:14.274 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-03-24T10:40:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:40:14.302 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-24T10:40:14.302 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-03-24T10:40:14.302 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-03-24T10:40:14.302 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-03-24T10:40:14.308 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:40:14.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:14.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:40:14.375 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:40:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:40:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:40:14.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-03-24T10:40:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:40:14.527 INFO:teuthology.orchestra.run.smithi078.stdout:client4903 2024-03-24T10:40:14.527 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:40:14.528 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:40:14.572 INFO:tasks.cephfs.test_newops:Test for new getvxattr op... 2024-03-24T10:40:14.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:14.572 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir newop_getvxattr_dir) 2024-03-24T10:40:14.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:14.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.pin.random ./newop_getvxattr_dir) 2024-03-24T10:40:14.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:40:14.709 INFO:teuthology.orchestra.run.smithi078.stderr:./newop_getvxattr_dir: ceph.dir.pin.random: No such attribute 2024-03-24T10:40:14.709 INFO:tasks.cephfs.test_newops:Test for new getvxattr op succeeds 2024-03-24T10:40:14.709 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-24T10:40:14.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:40:14.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:40:14.834 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-24T10:40:14.834 INFO:tasks.cephfs.mount:Terminating background process 2024-03-24T10:40:14.834 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:40:14.834 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:40:14.879 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:40:14.879 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:40:14.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 Processor -- start 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 -- start start 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 0x7f166c10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0f26c0 con 0x7f166c10cdc0 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0fa290 con 0x7f166c10c970 2024-03-24T10:40:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1671a06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0f95c0 con 0x7f166c0f5920 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1669fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f166a800700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 0x7f166c10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1669fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60232/0 (socket says 172.21.15.73:60232) 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.100 7f1669fff700 1 -- 172.21.15.73:0/4030021577 learned_addr learned my addr 172.21.15.73:0/4030021577 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1669fff700 1 -- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 msgr2=0x7f166c10c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1669fff700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 0x7f166c10c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1669fff700 1 -- 172.21.15.73:0/4030021577 >> v1:172.21.15.73:6789/0 conn(0x7f166c10cdc0 legacy=0x7f166c0f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1669fff700 1 -- 172.21.15.73:0/4030021577 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c1aa5e0 con 0x7f166c10c970 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f16697fe700 1 -- 172.21.15.73:0/4030021577 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076148872 0 0) 0x7f1664001490 con 0x7f166c10cdc0 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f166a800700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 0x7f166c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1669fff700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1660002f70 tx=0x7f1660009a80).ready entity=mon.1 client_cookie=e27ec14a559077da server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f16697fe700 1 -- 172.21.15.73:0/4030021577 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f166c1aa5e0 con 0x7f166c10c970 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f16697fe700 1 -- 172.21.15.73:0/4030021577 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000f510 con 0x7f166c10c970 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f16697fe700 1 -- 172.21.15.73:0/4030021577 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f166000f6f0 con 0x7f166c10c970 2024-03-24T10:40:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1671a06700 1 -- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 msgr2=0x7f166c0f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.101 7f1671a06700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1660002f70 tx=0x7f1660009a80).stop 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 -- 172.21.15.73:0/4030021577 shutdown_connections 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0f5920 0x7f166c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 --2- 172.21.15.73:0/4030021577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c10c970 0x7f166c0f1890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 -- 172.21.15.73:0/4030021577 >> 172.21.15.73:0/4030021577 conn(0x7f166c113a70 msgr2=0x7f166c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 -- 172.21.15.73:0/4030021577 shutdown_connections 2024-03-24T10:40:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.102 7f1671a06700 1 -- 172.21.15.73:0/4030021577 wait complete. 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 Processor -- start 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 -- start start 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 0x7f166c1b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0d8e40 0x7f166c1b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0f7970 con 0x7f166c0dd840 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c1b4fa0 con 0x7f166c0d89f0 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1671a06700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166c1b51a0 con 0x7f166c0d8e40 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55514/0 (socket says 172.21.15.73:55514) 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 -- 172.21.15.73:0/1203348788 learned_addr learned my addr 172.21.15.73:0/1203348788 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1669fff700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 0x7f166c1b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166b001700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0d8e40 0x7f166c1b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 -- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0d8e40 msgr2=0x7f166c1b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0d8e40 0x7f166c1b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 -- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 msgr2=0x7f166c1b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 0x7f166c1b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f166a800700 1 -- 172.21.15.73:0/1203348788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c1b53d0 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.125 7f1669fff700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 0x7f166c1b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f166a800700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f165c00c000 tx=0x7f165c00bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f165c00f040 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00c9a0 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f165c00cd70 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f1671a06700 1 -- 172.21.15.73:0/1203348788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c1bbab0 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f1671a06700 1 -- 172.21.15.73:0/1203348788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c1bbe90 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f165c011070 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.126 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f165c010040 con 0x7f166c0dd840 2024-03-24T10:40:15.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.127 7f1671a06700 1 -- 172.21.15.73:0/1203348788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c0a85c0 con 0x7f166c0dd840 2024-03-24T10:40:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.130 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f165c00c5a0 con 0x7f166c0dd840 2024-03-24T10:40:15.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.237 7f1671a06700 1 -- 172.21.15.73:0/1203348788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f166c0f08e0 con 0x7f166c0dd840 2024-03-24T10:40:15.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.238 7f165b7fe700 1 -- 172.21.15.73:0/1203348788 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f165c000c30 con 0x7f166c0dd840 2024-03-24T10:40:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:15.239 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:05.778914","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 >> v1:172.21.15.73:6816/43277 conn(0x7f16480145b0 legacy=0x7f1648016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 msgr2=0x7f166c0d83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f165c00c000 tx=0x7f165c00bf70).stop 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 shutdown_connections 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f166c0d8e40 0x7f166c1b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f166c0dd840 0x7f166c0d83c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 --2- 172.21.15.73:0/1203348788 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f166c0d89f0 0x7f166c1b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 >> 172.21.15.73:0/1203348788 conn(0x7f166c0c58f0 msgr2=0x7f166c1a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 shutdown_connections 2024-03-24T10:40:15.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.239 7f1671a06700 1 -- 172.21.15.73:0/1203348788 wait complete. 2024-03-24T10:40:15.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:40:02.846332', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:40:03.756602', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:40:15.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:40:15.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.378 7f2cc7d9c700 1 Processor -- start 2024-03-24T10:40:15.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.378 7f2cc7d9c700 1 -- start start 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cc00f5920 0x7f2cc00f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 0x7f2cc010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 0x7f2cc010e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00f9230 con 0x7f2cc00f5920 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc010ef10 con 0x7f2cc00f1ec0 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc7d9c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc01aa660 con 0x7f2cc00f2310 2024-03-24T10:40:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cc00f5920 0x7f2cc00f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc5398700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 0x7f2cc010e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cc00f5920 0x7f2cc00f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55516/0 (socket says 172.21.15.73:55516) 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 -- 172.21.15.73:0/2735606148 learned_addr learned my addr 172.21.15.73:0/2735606148 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cbffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 0x7f2cc010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 -- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 msgr2=0x7f2cc010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 0x7f2cc010e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 -- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 msgr2=0x7f2cc010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 0x7f2cc010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 -- 172.21.15.73:0/2735606148 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc01aa810 con 0x7f2cc00f5920 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc5398700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 0x7f2cc010e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cbffff700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 0x7f2cc010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.379 7f2cc4b97700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00f5920 0x7f2cc00f1890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f2cc00f4640 tx=0x7f2cb0009e10).ready entity=mon.0 client_cookie=4a3e364dcbc6ada7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cbf7fe700 1 -- 172.21.15.73:0/2735606148 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2cc01aa810 con 0x7f2cc00f5920 2024-03-24T10:40:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cbf7fe700 1 -- 172.21.15.73:0/2735606148 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000b890 con 0x7f2cc00f5920 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cbf7fe700 1 -- 172.21.15.73:0/2735606148 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2cb000ba70 con 0x7f2cc00f5920 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 -- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00f5920 msgr2=0x7f2cc00f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00f5920 0x7f2cc00f1890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f2cc00f4640 tx=0x7f2cb0009e10).stop 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 -- 172.21.15.73:0/2735606148 shutdown_connections 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc00f2310 0x7f2cc010e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00f5920 0x7f2cc00f1890 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 --2- 172.21.15.73:0/2735606148 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00f1ec0 0x7f2cc010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 -- 172.21.15.73:0/2735606148 >> 172.21.15.73:0/2735606148 conn(0x7f2cc0113a70 msgr2=0x7f2cc00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 -- 172.21.15.73:0/2735606148 shutdown_connections 2024-03-24T10:40:15.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.380 7f2cc7d9c700 1 -- 172.21.15.73:0/2735606148 wait complete. 2024-03-24T10:40:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.403 7f2cc7d9c700 1 Processor -- start 2024-03-24T10:40:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.403 7f2cc7d9c700 1 -- start start 2024-03-24T10:40:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.403 7f2cc7d9c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.403 7f2cc7d9c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc01b4550 0x7f2cc01b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00be330 con 0x7f2cc00cd8c0 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc01b4fd0 con 0x7f2cc00ce340 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00e0bd0 con 0x7f2cc01b4550 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc4b97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60238/0 (socket says 172.21.15.73:60238) 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc4b97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55532/0 (socket says 172.21.15.73:55532) 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 -- 172.21.15.73:0/3273138575 learned_addr learned my addr 172.21.15.73:0/3273138575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc5398700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc01b4550 0x7f2cc01b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 -- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc01b4550 msgr2=0x7f2cc01b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc01b4550 0x7f2cc01b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 -- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 msgr2=0x7f2cc00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 -- 172.21.15.73:0/3273138575 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00e07b0 con 0x7f2cc00ce340 2024-03-24T10:40:15.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc4b97700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbffff700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2cc00d1470 tx=0x7f2cb400ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2cc00e07b0 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400c9a0 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc00d5260 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2cb400f040 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.404 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc01bb900 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.405 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2cb4011070 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.405 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2cb4010040 con 0x7f2cc00ce340 2024-03-24T10:40:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.405 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc00f08e0 con 0x7f2cc00ce340 2024-03-24T10:40:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.408 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2cb400c5a0 con 0x7f2cc00ce340 2024-03-24T10:40:15.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.514 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2cc01ae850 con 0x7f2cc00ce340 2024-03-24T10:40:15.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.514 7f2cbdffb700 1 -- 172.21.15.73:0/3273138575 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2cb4000c30 con 0x7f2cc00ce340 2024-03-24T10:40:15.516 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:40:15.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.515 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 >> v1:172.21.15.73:6816/43277 conn(0x7f2ca00145b0 legacy=0x7f2ca0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 msgr2=0x7f2cc01b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2cc00d1470 tx=0x7f2cb400ecd0).stop 2024-03-24T10:40:15.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 shutdown_connections 2024-03-24T10:40:15.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f2cc01b4550 0x7f2cc01b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc00cd8c0 0x7f2cc00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 --2- 172.21.15.73:0/3273138575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cc00ce340 0x7f2cc01b3f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 >> 172.21.15.73:0/3273138575 conn(0x7f2cc00c5b30 msgr2=0x7f2cc00c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 shutdown_connections 2024-03-24T10:40:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.516 7f2cc7d9c700 1 -- 172.21.15.73:0/3273138575 wait complete. 2024-03-24T10:40:15.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:40:15.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 Processor -- start 2024-03-24T10:40:15.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 -- start start 2024-03-24T10:40:15.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 0x7fcb6410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 0x7fcb640f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640f26c0 con 0x7fcb6410cdc0 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640fa290 con 0x7fcb640f5920 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb6afea700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640f95c0 con 0x7fcb6410c970 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb63fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb6410cdc0 0x7fcb640f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41880/0 (socket says 172.21.15.73:41880) 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb63fff700 1 -- 172.21.15.73:0/3515675323 learned_addr learned my addr 172.21.15.73:0/3515675323 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb637fe700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 0x7fcb6410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.655 7fcb62ffd700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 0x7fcb640f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb627fc700 1 -- 172.21.15.73:0/3515675323 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220624910 0 0) 0x7fcb5c001490 con 0x7fcb6410cdc0 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb627fc700 1 -- 172.21.15.73:0/3515675323 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb50003270 con 0x7fcb6410cdc0 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb62ffd700 1 -- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 msgr2=0x7fcb6410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb62ffd700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 0x7fcb6410c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb62ffd700 1 -- 172.21.15.73:0/3515675323 >> v1:172.21.15.73:6789/0 conn(0x7fcb6410cdc0 legacy=0x7fcb640f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb62ffd700 1 -- 172.21.15.73:0/3515675323 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb641aa5e0 con 0x7fcb6410c970 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb637fe700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 0x7fcb6410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb62ffd700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 0x7fcb640f1890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcb58002f70 tx=0x7fcb5800b9a0).ready entity=mon.2 client_cookie=77bd148c5e2d992e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb627fc700 1 -- 172.21.15.73:0/3515675323 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb641aa5e0 con 0x7fcb6410c970 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb627fc700 1 -- 172.21.15.73:0/3515675323 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800d570 con 0x7fcb6410c970 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb627fc700 1 -- 172.21.15.73:0/3515675323 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb5800d940 con 0x7fcb6410c970 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb6afea700 1 -- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 msgr2=0x7fcb640f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.656 7fcb6afea700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 0x7fcb640f1890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcb58002f70 tx=0x7fcb5800b9a0).stop 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 -- 172.21.15.73:0/3515675323 shutdown_connections 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb640f5920 0x7fcb6410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 --2- 172.21.15.73:0/3515675323 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb6410c970 0x7fcb640f1890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 -- 172.21.15.73:0/3515675323 >> 172.21.15.73:0/3515675323 conn(0x7fcb64113a70 msgr2=0x7fcb640f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 -- 172.21.15.73:0/3515675323 shutdown_connections 2024-03-24T10:40:15.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.657 7fcb6afea700 1 -- 172.21.15.73:0/3515675323 wait complete. 2024-03-24T10:40:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.679 7fcb6afea700 1 Processor -- start 2024-03-24T10:40:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 -- start start 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 0x7fcb641ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64113cd0 con 0x7fcb641b4b40 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640daee0 con 0x7fcb641ae680 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb6afea700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641b55c0 con 0x7fcb641adc00 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb637fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 0x7fcb641ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60264/0 (socket says 172.21.15.73:60264) 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55538/0 (socket says 172.21.15.73:55538) 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 -- 172.21.15.73:0/3987627958 learned_addr learned my addr 172.21.15.73:0/3987627958 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb637fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 0x7fcb641ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42612/0 (socket says 172.21.15.73:42612) 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 -- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 msgr2=0x7fcb641ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 0x7fcb641ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 -- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 msgr2=0x7fcb641b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 -- 172.21.15.73:0/3987627958 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640d4d10 con 0x7fcb641ae680 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb63fff700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.680 7fcb62ffd700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fcb5800dfc0 tx=0x7fcb580068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb640d4d10 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58011610 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb640d5e40 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb58022020 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb641bbef0 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fcb580119e0 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.681 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fcb5800c6f0 con 0x7fcb641ae680 2024-03-24T10:40:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.682 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb640f08e0 con 0x7fcb641ae680 2024-03-24T10:40:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.685 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fcb58011400 con 0x7fcb641ae680 2024-03-24T10:40:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.791 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb640a61a0 con 0x7fcb641ae680 2024-03-24T10:40:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.791 7fcb60ff9700 1 -- 172.21.15.73:0/3987627958 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb5800d360 con 0x7fcb641ae680 2024-03-24T10:40:15.792 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.792 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 >> v1:172.21.15.73:6816/43277 conn(0x7fcb440145b0 legacy=0x7fcb44016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.792 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 msgr2=0x7fcb641b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.792 7fcb6afea700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fcb5800dfc0 tx=0x7fcb580068c0).stop 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 shutdown_connections 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb641b4b40 0x7fcb641b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fcb641adc00 0x7fcb641ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 --2- 172.21.15.73:0/3987627958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb641ae680 0x7fcb641b4510 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 >> 172.21.15.73:0/3987627958 conn(0x7fcb640c5930 msgr2=0x7fcb640d6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 shutdown_connections 2024-03-24T10:40:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.793 7fcb6afea700 1 -- 172.21.15.73:0/3987627958 wait complete. 2024-03-24T10:40:15.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:40:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 Processor -- start 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 -- start start 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 0x7fd56010b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 0x7fd5601a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5601a09f0 con 0x7fd56010b6c0 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600fa510 con 0x7fd5600f5990 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.933 7fd5678cd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601a0c10 con 0x7fd56010bb10 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd56010b6c0 0x7fd56019fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41884/0 (socket says 172.21.15.73:41884) 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55f7fe700 1 -- 172.21.15.73:0/2885199102 learned_addr learned my addr 172.21.15.73:0/2885199102 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 0x7fd5601a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55ffff700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 0x7fd56010b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55effd700 1 -- 172.21.15.73:0/2885199102 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723803283 0 0) 0x7fd550001110 con 0x7fd56010b6c0 2024-03-24T10:40:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55effd700 1 -- 172.21.15.73:0/2885199102 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c003270 con 0x7fd56010b6c0 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 -- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 msgr2=0x7fd56010b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 0x7fd56010b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 -- 172.21.15.73:0/2885199102 >> v1:172.21.15.73:6789/0 conn(0x7fd56010b6c0 legacy=0x7fd56019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 -- 172.21.15.73:0/2885199102 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5601a9350 con 0x7fd56010bb10 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55ffff700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 0x7fd56010b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd564ec9700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 0x7fd5601a03c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd5600f4740 tx=0x7fd558009cf0).ready entity=mon.2 client_cookie=fcd8c8f905855878 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55effd700 1 -- 172.21.15.73:0/2885199102 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5601a9350 con 0x7fd56010bb10 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55effd700 1 -- 172.21.15.73:0/2885199102 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800b840 con 0x7fd56010bb10 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd55effd700 1 -- 172.21.15.73:0/2885199102 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd55800ba20 con 0x7fd56010bb10 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd5678cd700 1 -- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 msgr2=0x7fd5601a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.934 7fd5678cd700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 0x7fd5601a03c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd5600f4740 tx=0x7fd558009cf0).stop 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 -- 172.21.15.73:0/2885199102 shutdown_connections 2024-03-24T10:40:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd56010bb10 0x7fd5601a03c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 --2- 172.21.15.73:0/2885199102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5600f5990 0x7fd56010b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 -- 172.21.15.73:0/2885199102 >> 172.21.15.73:0/2885199102 conn(0x7fd5601139f0 msgr2=0x7fd5600f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 -- 172.21.15.73:0/2885199102 shutdown_connections 2024-03-24T10:40:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.935 7fd5678cd700 1 -- 172.21.15.73:0/2885199102 wait complete. 2024-03-24T10:40:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.957 7fd5678cd700 1 Processor -- start 2024-03-24T10:40:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.957 7fd5678cd700 1 -- start start 2024-03-24T10:40:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600cab70 con 0x7fd5600d6dc0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601b1e20 con 0x7fd5601b13a0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600cadb0 con 0x7fd5600cb1d0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd564ec9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55550/0 (socket says 172.21.15.73:55550) 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 -- 172.21.15.73:0/3237282887 learned_addr learned my addr 172.21.15.73:0/3237282887 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd564ec9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60282/0 (socket says 172.21.15.73:60282) 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55ffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42618/0 (socket says 172.21.15.73:42618) 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 -- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 msgr2=0x7fd5600d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 -- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 msgr2=0x7fd5601b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 -- 172.21.15.73:0/3237282887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600f1810 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55ffff700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd564ec9700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55f7fe700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd5600d76b0 tx=0x7fd55000c810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5600f1810 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5500072e0 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5600f1b30 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd550005810 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.958 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5600f2060 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.959 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd550005a10 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.959 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd5500148d0 con 0x7fd5600d6dc0 2024-03-24T10:40:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.959 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5600f2710 con 0x7fd5600d6dc0 2024-03-24T10:40:15.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:15.962 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd5500070d0 con 0x7fd5600d6dc0 2024-03-24T10:40:16.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.068 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5600f0860 con 0x7fd5600d6dc0 2024-03-24T10:40:16.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.068 7fd55d7fa700 1 -- 172.21.15.73:0/3237282887 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5600f14a0 con 0x7fd5600d6dc0 2024-03-24T10:40:16.070 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.069 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 >> v1:172.21.15.73:6816/43277 conn(0x7fd5400145b0 legacy=0x7fd540016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.069 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 msgr2=0x7fd5601b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.069 7fd5678cd700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd5600d76b0 tx=0x7fd55000c810).stop 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 shutdown_connections 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5601b13a0 0x7fd5601b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd5600cb1d0 0x7fd5600d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 --2- 172.21.15.73:0/3237282887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5600d6dc0 0x7fd5601b0d70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 >> 172.21.15.73:0/3237282887 conn(0x7fd5600c58a0 msgr2=0x7fd5600cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 shutdown_connections 2024-03-24T10:40:16.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.070 7fd5678cd700 1 -- 172.21.15.73:0/3237282887 wait complete. 2024-03-24T10:40:16.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:40:16.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 Processor -- start 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 -- start start 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 0x7fb4f80f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80f1e20 con 0x7fb4f810eed0 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80fb660 con 0x7fb4f810ea80 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.208 7fb4ff9ed700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8106970 con 0x7fb4f8106520 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 0x7fb4f80f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42630/0 (socket says 172.21.15.73:42630) 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4fcfe9700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb4f810eed0 0x7fb4f80f1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41900/0 (socket says 172.21.15.73:41900) 2024-03-24T10:40:16.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f7fff700 1 -- 172.21.15.73:0/1885402657 learned_addr learned my addr 172.21.15.73:0/1885402657 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 -- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 msgr2=0x7fb4f810e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 -- 172.21.15.73:0/1885402657 >> v1:172.21.15.73:6789/0 conn(0x7fb4f810eed0 legacy=0x7fb4f80f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f6ffd700 1 -- 172.21.15.73:0/1885402657 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564173897 0 0) 0x7fb4f0001490 con 0x7fb4f810eed0 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 -- 172.21.15.73:0/1885402657 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f81ac7b0 con 0x7fb4f810ea80 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f7fff700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f77fe700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 0x7fb4f80f0ff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb4f80fb810 tx=0x7fb4e800ba50).ready entity=mon.1 client_cookie=b8d2050f654f2fc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f6ffd700 1 -- 172.21.15.73:0/1885402657 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4f81ac7b0 con 0x7fb4f810ea80 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f6ffd700 1 -- 172.21.15.73:0/1885402657 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800d570 con 0x7fb4f810ea80 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4f6ffd700 1 -- 172.21.15.73:0/1885402657 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4e800d940 con 0x7fb4f810ea80 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4ff9ed700 1 -- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 msgr2=0x7fb4f80f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.209 7fb4ff9ed700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 0x7fb4f80f0ff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb4f80fb810 tx=0x7fb4e800ba50).stop 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 -- 172.21.15.73:0/1885402657 shutdown_connections 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f8106520 0x7fb4f810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 --2- 172.21.15.73:0/1885402657 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f810ea80 0x7fb4f80f0ff0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 -- 172.21.15.73:0/1885402657 >> 172.21.15.73:0/1885402657 conn(0x7fb4f8114930 msgr2=0x7fb4f8114d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 -- 172.21.15.73:0/1885402657 shutdown_connections 2024-03-24T10:40:16.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.210 7fb4ff9ed700 1 -- 172.21.15.73:0/1885402657 wait complete. 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.232 7fb4ff9ed700 1 Processor -- start 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.232 7fb4ff9ed700 1 -- start start 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 0x7fb4f81b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 0x7fb4f81b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80c4af0 con 0x7fb4f81ae760 2024-03-24T10:40:16.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80e0490 con 0x7fb4f81ae310 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4ff9ed700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f81b52b0 con 0x7fb4f80e0040 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 0x7fb4f81b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 0x7fb4f81b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42640/0 (socket says 172.21.15.73:42640) 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f7fff700 1 -- 172.21.15.73:0/3909750533 learned_addr learned my addr 172.21.15.73:0/3909750533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 -- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 msgr2=0x7fb4f81adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 -- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 msgr2=0x7fb4f81b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 0x7fb4f81b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 -- 172.21.15.73:0/3909750533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80f01f0 con 0x7fb4f81ae760 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f77fe700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 0x7fb4f81b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4f7fff700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.233 7fb4fcfe9700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 0x7fb4f81b4c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb4f0000f40 tx=0x7fb4f000c930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4f80f01f0 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0005af0 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f81bbdd0 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4f00070d0 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f81bbfd0 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb4f001b070 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.234 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb4f0004f70 con 0x7fb4f81ae760 2024-03-24T10:40:16.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.235 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f80f08d0 con 0x7fb4f81ae760 2024-03-24T10:40:16.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.238 7fb4f57fa700 1 -- 172.21.15.73:0/3909750533 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb4f00058e0 con 0x7fb4f81ae760 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 >> v1:172.21.15.73:6816/43277 conn(0x7fb4d80145b0 legacy=0x7fb4d8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 msgr2=0x7fb4f81b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 0x7fb4f81b4c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb4f0000f40 tx=0x7fb4f000c930).stop 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 shutdown_connections 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4f81ae760 0x7fb4f81b4c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb4f80e0040 0x7fb4f81adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 --2- 172.21.15.73:0/3909750533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4f81ae310 0x7fb4f81b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 >> 172.21.15.73:0/3909750533 conn(0x7fb4f80c91d0 msgr2=0x7fb4f80c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 shutdown_connections 2024-03-24T10:40:16.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.381 7fb4ff9ed700 1 -- 172.21.15.73:0/3909750533 wait complete. 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd perf 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd df {plain|tree} {class|name} {} 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd blocked-by 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool stats {} 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool scrub [...] 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool deep-scrub [...] 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool repair [...] 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-recovery [...] 2024-03-24T10:40:16.384 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool force-backfill [...] 2024-03-24T10:40:16.385 INFO:teuthology.orchestra.run.smithi073.stderr:osd pool cancel-force-recovery [...] 2024-03-24T10:40:16.385 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-03-24T10:40:16.393 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-24T10:40:16.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.519 7f96fbee6700 1 Processor -- start 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.519 7f96fbee6700 1 -- start start 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 0x7f96f410e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96f40f2280 0x7f96f410e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f40f91a0 con 0x7f96f40f2280 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f410ee80 con 0x7f96f40f1e30 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41aa5d0 con 0x7f96f40f5890 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f8ce1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 0x7f96f410e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96f40f2280 0x7f96f410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96f40f2280 0x7f96f410e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55580/0 (socket says 172.21.15.73:55580) 2024-03-24T10:40:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f8ce1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42650/0 (socket says 172.21.15.73:42650) 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 -- 172.21.15.73:0/1067417643 learned_addr learned my addr 172.21.15.73:0/1067417643 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 0x7f96f410e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60310/0 (socket says 172.21.15.73:60310) 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 -- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 msgr2=0x7f96f40f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 -- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 msgr2=0x7f96f410e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 0x7f96f410e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 -- 172.21.15.73:0/1067417643 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f41aa780 con 0x7f96f40f2280 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f8ce1700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f94e2700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40f2280 0x7f96f410e850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f96ec0032f0 tx=0x7f96ec009de0).ready entity=mon.0 client_cookie=9bf6b8a655d0ff27 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f37fe700 1 -- 172.21.15.73:0/1067417643 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96f41aa780 con 0x7f96f40f2280 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f37fe700 1 -- 172.21.15.73:0/1067417643 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00b870 con 0x7f96f40f2280 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96f37fe700 1 -- 172.21.15.73:0/1067417643 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96ec00ba50 con 0x7f96f40f2280 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 -- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40f2280 msgr2=0x7f96f410e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.520 7f96fbee6700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40f2280 0x7f96f410e850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f96ec0032f0 tx=0x7f96ec009de0).stop 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 -- 172.21.15.73:0/1067417643 shutdown_connections 2024-03-24T10:40:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40f2280 0x7f96f410e850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40f5890 0x7f96f40f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 --2- 172.21.15.73:0/1067417643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40f1e30 0x7f96f410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 -- 172.21.15.73:0/1067417643 >> 172.21.15.73:0/1067417643 conn(0x7f96f41139e0 msgr2=0x7f96f40f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 -- 172.21.15.73:0/1067417643 shutdown_connections 2024-03-24T10:40:16.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.521 7f96fbee6700 1 -- 172.21.15.73:0/1067417643 wait complete. 2024-03-24T10:40:16.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 Processor -- start 2024-03-24T10:40:16.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 -- start start 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 0x7f96f40bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 0x7f96f40c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c1cd0 con 0x7f96f40cd780 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c1a10 con 0x7f96f40cca00 2024-03-24T10:40:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96fbee6700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c0aa0 con 0x7f96f40cce50 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96f8ce1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96f8ce1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55586/0 (socket says 172.21.15.73:55586) 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96f94e2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 0x7f96f40c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96f8ce1700 1 -- 172.21.15.73:0/3316718294 learned_addr learned my addr 172.21.15.73:0/3316718294 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.544 7f96f3fff700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 0x7f96f40bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 -- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 msgr2=0x7f96f40c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 0x7f96f40c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 -- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 msgr2=0x7f96f40bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 0x7f96f40bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 -- 172.21.15.73:0/3316718294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40c0c80 con 0x7f96f40cd780 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f94e2700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 0x7f96f40c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f3fff700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 0x7f96f40bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f8ce1700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f96e400c000 tx=0x7f96e400ec40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96f40c0c80 con 0x7f96f40cd780 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400c9a0 con 0x7f96f40cd780 2024-03-24T10:40:16.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f96e400f040 con 0x7f96f40cd780 2024-03-24T10:40:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f41bbe90 con 0x7f96f40cd780 2024-03-24T10:40:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f41bc270 con 0x7f96f40cd780 2024-03-24T10:40:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.545 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f96e4011070 con 0x7f96f40cd780 2024-03-24T10:40:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.546 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f96e4010040 con 0x7f96f40cd780 2024-03-24T10:40:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.546 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f40f0850 con 0x7f96f40cd780 2024-03-24T10:40:16.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.549 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f96e400c5a0 con 0x7f96f40cd780 2024-03-24T10:40:16.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.667 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f96f41aee40 con 0x7f96f40cd780 2024-03-24T10:40:16.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.667 7f96f1ffb700 1 -- 172.21.15.73:0/3316718294 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f96e4000c30 con 0x7f96f40cd780 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 >> v1:172.21.15.73:6816/43277 conn(0x7f96d80145b0 legacy=0x7f96d8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 msgr2=0x7f96f40cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f96e400c000 tx=0x7f96e400ec40).stop 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 shutdown_connections 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f96f40cce50 0x7f96f40c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96f40cd780 0x7f96f40cc3d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 --2- 172.21.15.73:0/3316718294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96f40cca00 0x7f96f40bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 >> 172.21.15.73:0/3316718294 conn(0x7f96f40de910 msgr2=0x7f96f40d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.668 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 shutdown_connections 2024-03-24T10:40:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.669 7f96fbee6700 1 -- 172.21.15.73:0/3316718294 wait complete. 2024-03-24T10:40:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-24T10:40:16.680 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-24T10:40:16.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:16.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-24T10:40:16.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-03-24T10:40:16.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:16.758 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-24T10:40:16.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.929 7f64c6c22700 1 Processor -- start 2024-03-24T10:40:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.929 7f64c6c22700 1 -- start start 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64c00f1ec0 0x7f64c010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c00f9230 con 0x7f64c00f2310 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c010f0e0 con 0x7f64c00f1ec0 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c01ac680 con 0x7f64c00f5920 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64bf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64bf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60328/0 (socket says 172.21.15.73:60328) 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64bf7fe700 1 -- 172.21.15.73:0/724133340 learned_addr learned my addr 172.21.15.73:0/724133340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 --2- 172.21.15.73:0/724133340 >> v2:172.21.15.73:3300/0 conn(0x7f64c00f1ec0 0x7f64c010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 -- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 msgr2=0x7f64c00f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 -- 172.21.15.73:0/724133340 >> v1:172.21.15.73:6789/0 conn(0x7f64c00f2310 legacy=0x7f64c010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64be7fc700 1 -- 172.21.15.73:0/724133340 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827399065 0 0) 0x7f64b8001110 con 0x7f64c00f2310 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 -- 172.21.15.73:0/724133340 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c01ac830 con 0x7f64c00f1ec0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64bf7fe700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64beffd700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00f1ec0 0x7f64c010e2b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f64b4002f70 tx=0x7f64b400b9f0).ready entity=mon.0 client_cookie=86da5fde3a30a60a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64be7fc700 1 -- 172.21.15.73:0/724133340 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64c01ac830 con 0x7f64c00f1ec0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64be7fc700 1 -- 172.21.15.73:0/724133340 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b400d5c0 con 0x7f64c00f1ec0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64be7fc700 1 -- 172.21.15.73:0/724133340 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64b400d990 con 0x7f64c00f1ec0 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 -- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00f1ec0 msgr2=0x7f64c010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.930 7f64c6c22700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00f1ec0 0x7f64c010e2b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f64b4002f70 tx=0x7f64b400b9f0).stop 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 -- 172.21.15.73:0/724133340 shutdown_connections 2024-03-24T10:40:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00f5920 0x7f64c00f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 --2- 172.21.15.73:0/724133340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00f1ec0 0x7f64c010e2b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 -- 172.21.15.73:0/724133340 >> 172.21.15.73:0/724133340 conn(0x7f64c0113a70 msgr2=0x7f64c00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 -- 172.21.15.73:0/724133340 shutdown_connections 2024-03-24T10:40:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.931 7f64c6c22700 1 -- 172.21.15.73:0/724133340 wait complete. 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 Processor -- start 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 -- start start 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00bc870 con 0x7f64c00c3b60 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00d8470 con 0x7f64c00c45e0 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.954 7f64c6c22700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00d7940 con 0x7f64c01b4ee0 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64beffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55592/0 (socket says 172.21.15.73:55592) 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bf7fe700 1 -- 172.21.15.73:0/1943126810 learned_addr learned my addr 172.21.15.73:0/1943126810 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42664/0 (socket says 172.21.15.73:42664) 2024-03-24T10:40:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64beffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60334/0 (socket says 172.21.15.73:60334) 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 -- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 msgr2=0x7f64c01b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 -- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 msgr2=0x7f64c00c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 -- 172.21.15.73:0/1943126810 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c01bbe20 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bf7fe700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64beffd700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bffff700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f64c00bf080 tx=0x7f64b800c560).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64c01bbe20 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8007030 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64b8006520 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c01bc020 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.955 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c01bc400 con 0x7f64c01b4ee0 2024-03-24T10:40:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.956 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f64b801a020 con 0x7f64c01b4ee0 2024-03-24T10:40:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.956 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f64b8003c20 con 0x7f64c01b4ee0 2024-03-24T10:40:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.956 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c00f08e0 con 0x7f64c01b4ee0 2024-03-24T10:40:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:16.959 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f64b800cd20 con 0x7f64c01b4ee0 2024-03-24T10:40:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.094 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64c00e2430 con 0x7f64c01b4ee0 2024-03-24T10:40:17.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.095 7f64bcff9700 1 -- 172.21.15.73:0/1943126810 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7f64c01145f0 con 0x7f64c01b4ee0 2024-03-24T10:40:17.096 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:17.096 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 >> v1:172.21.15.73:6816/43277 conn(0x7f64a00145b0 legacy=0x7f64a0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 msgr2=0x7f64c01b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f64c00bf080 tx=0x7f64b800c560).stop 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 shutdown_connections 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f64c01b4ee0 0x7f64c01b5330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64c00c3b60 0x7f64c00c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 --2- 172.21.15.73:0/1943126810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64c00c45e0 0x7f64c01b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 >> 172.21.15.73:0/1943126810 conn(0x7f64c00dc9c0 msgr2=0x7f64c00bdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 shutdown_connections 2024-03-24T10:40:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.096 7f64c6c22700 1 -- 172.21.15.73:0/1943126810 wait complete. 2024-03-24T10:40:17.099 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:17.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 Processor -- start 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 -- start start 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 0x7f62e410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 0x7f62e419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e40fa590 con 0x7f62e40f5a10 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e41a08a0 con 0x7f62e410b740 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62eb4f2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62e41a0ad0 con 0x7f62e410bb90 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 0x7f62e410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 0x7f62e419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e8aee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e8aee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42670/0 (socket says 172.21.15.73:42670) 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 0x7f62e419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60344/0 (socket says 172.21.15.73:60344) 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 0x7f62e410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55600/0 (socket says 172.21.15.73:55600) 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e8aee700 1 -- 172.21.15.73:0/3649383077 learned_addr learned my addr 172.21.15.73:0/3649383077 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e8aee700 1 -- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 msgr2=0x7f62e419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.236 7f62e8aee700 1 --2- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 0x7f62e419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e8aee700 1 -- 172.21.15.73:0/3649383077 >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 msgr2=0x7f62e410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e8aee700 1 --2- 172.21.15.73:0/3649383077 >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 0x7f62e410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e8aee700 1 -- 172.21.15.73:0/3649383077 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e41a73b0 con 0x7f62e410bb90 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e8aee700 1 --2- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f62e40f47c0 tx=0x7f62dc00d5d0).ready entity=mon.2 client_cookie=217248ff26643c51 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e2ffd700 1 -- 172.21.15.73:0/3649383077 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62e41a73b0 con 0x7f62e410bb90 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e2ffd700 1 -- 172.21.15.73:0/3649383077 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc010660 con 0x7f62e410bb90 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62e2ffd700 1 -- 172.21.15.73:0/3649383077 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62dc010a30 con 0x7f62e410bb90 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 -- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 msgr2=0x7f62e41a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 --2- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f62e40f47c0 tx=0x7f62dc00d5d0).stop 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 -- 172.21.15.73:0/3649383077 shutdown_connections 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 --2- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e410bb90 0x7f62e41a0270 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 --2- 172.21.15.73:0/3649383077 >> v2:172.21.15.73:3300/0 conn(0x7f62e40f5a10 0x7f62e410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 --2- 172.21.15.73:0/3649383077 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e410b740 0x7f62e419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.237 7f62eb4f2700 1 -- 172.21.15.73:0/3649383077 >> 172.21.15.73:0/3649383077 conn(0x7f62e4113a70 msgr2=0x7f62e40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.238 7f62eb4f2700 1 -- 172.21.15.73:0/3649383077 shutdown_connections 2024-03-24T10:40:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.238 7f62eb4f2700 1 -- 172.21.15.73:0/3649383077 wait complete. 2024-03-24T10:40:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.260 7f62eb4f2700 1 Processor -- start 2024-03-24T10:40:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.260 7f62eb4f2700 1 -- start start 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 0x7f62e41b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 0x7f62e41b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40d6ce0 con 0x7f62e40ce3f0 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40dd190 con 0x7f62e41b0a50 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62eb4f2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40d78d0 con 0x7f62e40cee70 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55612/0 (socket says 172.21.15.73:55612) 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e3fff700 1 -- 172.21.15.73:0/2954093377 learned_addr learned my addr 172.21.15.73:0/2954093377 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 0x7f62e41b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 0x7f62e41b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 -- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 msgr2=0x7f62e41b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 0x7f62e41b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 -- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 msgr2=0x7f62e40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 -- 172.21.15.73:0/2954093377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e41b7b90 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e3fff700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e37fe700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 0x7f62e41b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.261 7f62e8aee700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 0x7f62e41b0ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f62e40f47c0 tx=0x7f62dc006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62e41b7b90 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc01f070 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e41b7d90 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62dc0189f0 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e41b8170 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f62dc02a060 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.262 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f62dc01c120 con 0x7f62e41b0a50 2024-03-24T10:40:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.263 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40f08e0 con 0x7f62e41b0a50 2024-03-24T10:40:17.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.266 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f62dc018400 con 0x7f62e41b0a50 2024-03-24T10:40:17.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.373 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62e40e2430 con 0x7f62e41b0a50 2024-03-24T10:40:17.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.373 7f62e17fa700 1 -- 172.21.15.73:0/2954093377 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f62dc00dc60 con 0x7f62e41b0a50 2024-03-24T10:40:17.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:17.375 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:05.778914","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.374 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 >> v1:172.21.15.73:6816/43277 conn(0x7f62c40145b0 legacy=0x7f62c4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.374 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 msgr2=0x7f62e41b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.374 7f62eb4f2700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 0x7f62e41b0ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f62e40f47c0 tx=0x7f62dc006c40).stop 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 shutdown_connections 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f62e41b0a50 0x7f62e41b0ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62e40ce3f0 0x7f62e40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 --2- 172.21.15.73:0/2954093377 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f62e40cee70 0x7f62e41b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 >> 172.21.15.73:0/2954093377 conn(0x7f62e40e0620 msgr2=0x7f62e41a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 shutdown_connections 2024-03-24T10:40:17.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.375 7f62eb4f2700 1 -- 172.21.15.73:0/2954093377 wait complete. 2024-03-24T10:40:17.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-03-24 10:39:11.524237', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24 10:40:02.846332', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24 10:40:03.756602', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:40:17.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-24T10:40:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.514 7fad59287700 1 Processor -- start 2024-03-24T10:40:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.514 7fad59287700 1 -- start start 2024-03-24T10:40:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 0x7fad540f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 0x7fad5410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad540f9230 con 0x7fad540f1ec0 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5410f0e0 con 0x7fad540f2310 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad541ac680 con 0x7fad540f5920 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 0x7fad5410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5185b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad540f1ec0 0x7fad5410e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41920/0 (socket says 172.21.15.73:41920) 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5185b700 1 -- 172.21.15.73:0/2488133839 learned_addr learned my addr 172.21.15.73:0/2488133839 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5205c700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 0x7fad540f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5105a700 1 -- 172.21.15.73:0/2488133839 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084322799 0 0) 0x7fad44001110 con 0x7fad540f1ec0 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 -- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 msgr2=0x7fad540f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 0x7fad540f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 -- 172.21.15.73:0/2488133839 >> v1:172.21.15.73:6789/0 conn(0x7fad540f1ec0 legacy=0x7fad5410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 -- 172.21.15.73:0/2488133839 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad541ac830 con 0x7fad540f2310 2024-03-24T10:40:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5205c700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 0x7fad540f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5285d700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 0x7fad5410eab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fad541037f0 tx=0x7fad4c009d70).ready entity=mon.1 client_cookie=203735e7908bafc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5105a700 1 -- 172.21.15.73:0/2488133839 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad541ac830 con 0x7fad540f2310 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5105a700 1 -- 172.21.15.73:0/2488133839 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00b7c0 con 0x7fad540f2310 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad5105a700 1 -- 172.21.15.73:0/2488133839 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad4c00b9a0 con 0x7fad540f2310 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 -- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 msgr2=0x7fad5410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.515 7fad59287700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 0x7fad5410eab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fad541037f0 tx=0x7fad4c009d70).stop 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 -- 172.21.15.73:0/2488133839 shutdown_connections 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540f2310 0x7fad5410eab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 --2- 172.21.15.73:0/2488133839 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540f5920 0x7fad540f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 -- 172.21.15.73:0/2488133839 >> 172.21.15.73:0/2488133839 conn(0x7fad54113a70 msgr2=0x7fad540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 -- 172.21.15.73:0/2488133839 shutdown_connections 2024-03-24T10:40:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.516 7fad59287700 1 -- 172.21.15.73:0/2488133839 wait complete. 2024-03-24T10:40:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 Processor -- start 2024-03-24T10:40:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 -- start start 2024-03-24T10:40:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 0x7fad540d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad540d7f50 con 0x7fad540cbe40 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad540d7070 con 0x7fad540bb420 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad59287700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad540d72a0 con 0x7fad540cb9f0 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad5185b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad5205c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.539 7fad5285d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 0x7fad540d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42690/0 (socket says 172.21.15.73:42690) 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5205c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60374/0 (socket says 172.21.15.73:60374) 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 -- 172.21.15.73:0/4278377504 learned_addr learned my addr 172.21.15.73:0/4278377504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 -- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 msgr2=0x7fad540cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 -- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 msgr2=0x7fad540d6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 0x7fad540d6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 -- 172.21.15.73:0/4278377504 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad541bb8c0 con 0x7fad540cb9f0 2024-03-24T10:40:17.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5285d700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 0x7fad540d6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5205c700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad5185b700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fad44000bc0 tx=0x7fad4400c7b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad541bb8c0 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400ce20 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad59287700 1 -- 172.21.15.73:0/4278377504 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad541bbac0 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad44005620 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.540 7fad59287700 1 -- 172.21.15.73:0/4278377504 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad541bbea0 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.541 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fad4401b070 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.541 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fad44004cc0 con 0x7fad540cb9f0 2024-03-24T10:40:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.541 7fad59287700 1 -- 172.21.15.73:0/4278377504 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad540f08e0 con 0x7fad540cb9f0 2024-03-24T10:40:17.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.544 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fad440070d0 con 0x7fad540cb9f0 2024-03-24T10:40:17.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.651 7fad59287700 1 -- 172.21.15.73:0/4278377504 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad541ae8d0 con 0x7fad540cb9f0 2024-03-24T10:40:17.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.651 7fad437fe700 1 -- 172.21.15.73:0/4278377504 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad44000c30 con 0x7fad540cb9f0 2024-03-24T10:40:17.652 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-03-24T10:40:17.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 >> v1:172.21.15.73:6816/43277 conn(0x7fad300145b0 legacy=0x7fad30016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 msgr2=0x7fad540d6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fad44000bc0 tx=0x7fad4400c7b0).stop 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 shutdown_connections 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad540cbe40 0x7fad540d6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad540bb420 0x7fad540cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 --2- 172.21.15.73:0/4278377504 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fad540cb9f0 0x7fad540d6410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 >> 172.21.15.73:0/4278377504 conn(0x7fad540c5ae0 msgr2=0x7fad540c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 shutdown_connections 2024-03-24T10:40:17.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.652 7fad59287700 1 -- 172.21.15.73:0/4278377504 wait complete. 2024-03-24T10:40:17.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 Processor -- start 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 -- start start 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 0x7f06b01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b01a0a70 con 0x7f06b010b740 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00fa590 con 0x7f06b010bb90 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06b6336700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b01a0c90 con 0x7f06b00f5a10 2024-03-24T10:40:17.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06af086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06af887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 0x7f06b01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06af086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42706/0 (socket says 172.21.15.73:42706) 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06af086700 1 -- 172.21.15.73:0/2253018445 learned_addr learned my addr 172.21.15.73:0/2253018445 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.790 7f06ae885700 1 --1- 172.21.15.73:0/2253018445 >> v1:172.21.15.73:6789/0 conn(0x7f06b010b740 0x7f06b019fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41932/0 (socket says 172.21.15.73:41932) 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af086700 1 -- 172.21.15.73:0/2253018445 >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 msgr2=0x7f06b01a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af086700 1 --2- 172.21.15.73:0/2253018445 >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 0x7f06b01a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af086700 1 -- 172.21.15.73:0/2253018445 >> v1:172.21.15.73:6789/0 conn(0x7f06b010b740 legacy=0x7f06b019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af086700 1 -- 172.21.15.73:0/2253018445 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b01a93d0 con 0x7f06b00f5a10 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af887700 1 --2- 172.21.15.73:0/2253018445 >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 0x7f06b01a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06af086700 1 --2- 172.21.15.73:0/2253018445 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a400bc00).ready entity=mon.2 client_cookie=bffd1e9e05db99a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06ae084700 1 -- 172.21.15.73:0/2253018445 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06b01a93d0 con 0x7f06b00f5a10 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06ae084700 1 -- 172.21.15.73:0/2253018445 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400dc80 con 0x7f06b00f5a10 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06ae084700 1 -- 172.21.15.73:0/2253018445 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06a4010660 con 0x7f06b00f5a10 2024-03-24T10:40:17.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06b6336700 1 -- 172.21.15.73:0/2253018445 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 msgr2=0x7f06b010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.791 7f06b6336700 1 --2- 172.21.15.73:0/2253018445 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f06a4002f70 tx=0x7f06a400bc00).stop 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 -- 172.21.15.73:0/2253018445 shutdown_connections 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 --2- 172.21.15.73:0/2253018445 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b00f5a10 0x7f06b010b110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 --2- 172.21.15.73:0/2253018445 >> v2:172.21.15.73:3300/0 conn(0x7f06b010bb90 0x7f06b01a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 -- 172.21.15.73:0/2253018445 >> 172.21.15.73:0/2253018445 conn(0x7f06b0113a70 msgr2=0x7f06b00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 -- 172.21.15.73:0/2253018445 shutdown_connections 2024-03-24T10:40:17.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.792 7f06b6336700 1 -- 172.21.15.73:0/2253018445 wait complete. 2024-03-24T10:40:17.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.814 7f06b6336700 1 Processor -- start 2024-03-24T10:40:17.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.814 7f06b6336700 1 -- start start 2024-03-24T10:40:17.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 0x7f06b01b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 0x7f06b01b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00d3a20 con 0x7f06b01ae770 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00d66c0 con 0x7f06b01adcf0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00d4790 con 0x7f06b01b4dd0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 0x7f06b01b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06ae885700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 0x7f06b01b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60384/0 (socket says 172.21.15.73:60384) 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 0x7f06b01b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42710/0 (socket says 172.21.15.73:42710) 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 -- 172.21.15.73:0/3029151730 learned_addr learned my addr 172.21.15.73:0/3029151730 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 -- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 msgr2=0x7f06b01b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 0x7f06b01b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 -- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 msgr2=0x7f06b01b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 0x7f06b01b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 -- 172.21.15.73:0/3029151730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b01bbf10 con 0x7f06b01adcf0 2024-03-24T10:40:17.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06ae885700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 0x7f06b01b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06af086700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f06b00c52b0 tx=0x7f06a40068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06b01bbf10 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4022410 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 -- 172.21.15.73:0/3029151730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b01bc110 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06a401e070 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.815 7f06b6336700 1 -- 172.21.15.73:0/3029151730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b01bc4f0 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.816 7f06b6336700 1 -- 172.21.15.73:0/3029151730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b00d3e90 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.816 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f06a402b420 con 0x7f06b01adcf0 2024-03-24T10:40:17.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.817 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f06a4009960 con 0x7f06b01adcf0 2024-03-24T10:40:17.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.819 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f06a4010cd0 con 0x7f06b01adcf0 2024-03-24T10:40:17.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.924 7f06b6336700 1 -- 172.21.15.73:0/3029151730 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06b00f08e0 con 0x7f06b01adcf0 2024-03-24T10:40:17.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.924 7f06ac881700 1 -- 172.21.15.73:0/3029151730 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06a400d880 con 0x7f06b01adcf0 2024-03-24T10:40:17.925 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.925 7f06b6336700 1 -- 172.21.15.73:0/3029151730 >> v1:172.21.15.73:6816/43277 conn(0x7f06900145b0 legacy=0x7f0690016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.925 7f06b6336700 1 -- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 msgr2=0x7f06b01ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.925 7f06b6336700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f06b00c52b0 tx=0x7f06a40068c0).stop 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 -- 172.21.15.73:0/3029151730 shutdown_connections 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f06b01b4dd0 0x7f06b01b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f06b01adcf0 0x7f06b01ae140 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 --2- 172.21.15.73:0/3029151730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b01ae770 0x7f06b01b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:17.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 -- 172.21.15.73:0/3029151730 >> 172.21.15.73:0/3029151730 conn(0x7f06b00c5500 msgr2=0x7f06b01a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:17.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 -- 172.21.15.73:0/3029151730 shutdown_connections 2024-03-24T10:40:17.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:17.926 7f06b6336700 1 -- 172.21.15.73:0/3029151730 wait complete. 2024-03-24T10:40:17.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.065 7fd4ad6f0700 1 Processor -- start 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.065 7fd4ad6f0700 1 -- start start 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.065 7fd4ad6f0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4a810b910 0x7fd4a81a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81a59d0 0x7fd4a81a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a810bd60 con 0x7fd4a80f5a10 2024-03-24T10:40:18.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80fa590 con 0x7fd4a810b910 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81a0c50 con 0x7fd4a81a59d0 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4a810b910 0x7fd4a81a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a6cc5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81a59d0 0x7fd4a81a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a64c4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd4a80f5a10 0x7fd4a810b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41934/0 (socket says 172.21.15.73:41934) 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a64c4700 1 -- 172.21.15.73:0/1349553471 learned_addr learned my addr 172.21.15.73:0/1349553471 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 -- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81a59d0 msgr2=0x7fd4a81a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 --2- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81a59d0 0x7fd4a81a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 -- 172.21.15.73:0/1349553471 >> v1:172.21.15.73:6789/0 conn(0x7fd4a80f5a10 legacy=0x7fd4a810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 -- 172.21.15.73:0/1349553471 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a81a9470 con 0x7fd4a810b910 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a54c2700 1 -- 172.21.15.73:0/1349553471 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300127850 0 0) 0x7fd49c001110 con 0x7fd4a80f5a10 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a5cc3700 1 --2- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a810b910 0x7fd4a81a53a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd4a8103a10 tx=0x7fd49800ba20).ready entity=mon.0 client_cookie=5f89e921b02b326d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a54c2700 1 -- 172.21.15.73:0/1349553471 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4a81a9470 con 0x7fd4a810b910 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a54c2700 1 -- 172.21.15.73:0/1349553471 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49800d5c0 con 0x7fd4a810b910 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4a54c2700 1 -- 172.21.15.73:0/1349553471 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd49800d990 con 0x7fd4a810b910 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 -- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a810b910 msgr2=0x7fd4a81a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.066 7fd4ad6f0700 1 --2- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a810b910 0x7fd4a81a53a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd4a8103a10 tx=0x7fd49800ba20).stop 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 -- 172.21.15.73:0/1349553471 shutdown_connections 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 --2- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81a59d0 0x7fd4a81a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 --2- 172.21.15.73:0/1349553471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a810b910 0x7fd4a81a53a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 -- 172.21.15.73:0/1349553471 >> 172.21.15.73:0/1349553471 conn(0x7fd4a8113a70 msgr2=0x7fd4a80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 -- 172.21.15.73:0/1349553471 shutdown_connections 2024-03-24T10:40:18.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.067 7fd4ad6f0700 1 -- 172.21.15.73:0/1349553471 wait complete. 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 Processor -- start 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 -- start start 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a80df280 0x7fd4a81ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 0x7fd4a80d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 0x7fd4a80d9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80d5370 con 0x7fd4a80df280 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80d99a0 con 0x7fd4a81ac280 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4ad6f0700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80d9bd0 con 0x7fd4a81abe30 2024-03-24T10:40:18.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4a5cc3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 0x7fd4a80d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4a64c4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a80df280 0x7fd4a81ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4a6cc5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 0x7fd4a80d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4a5cc3700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 0x7fd4a80d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42730/0 (socket says 172.21.15.73:42730) 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.090 7fd4a5cc3700 1 -- 172.21.15.73:0/3786378299 learned_addr learned my addr 172.21.15.73:0/3786378299 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 -- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 msgr2=0x7fd4a80d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 0x7fd4a80d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 -- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a80df280 msgr2=0x7fd4a81ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a80df280 0x7fd4a81ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 -- 172.21.15.73:0/3786378299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a81b9910 con 0x7fd4a81ac280 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4a6cc5700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 0x7fd4a80d9370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd4a80c2820 tx=0x7fd4a000ed70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4a81b9910 con 0x7fd4a81ac280 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000c880 con 0x7fd4a81ac280 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a81b9b10 con 0x7fd4a81ac280 2024-03-24T10:40:18.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd4a000f040 con 0x7fd4a81ac280 2024-03-24T10:40:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.091 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a81b9ef0 con 0x7fd4a81ac280 2024-03-24T10:40:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.092 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd4a0022060 con 0x7fd4a81ac280 2024-03-24T10:40:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.092 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd4a0010040 con 0x7fd4a81ac280 2024-03-24T10:40:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.092 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a80f08e0 con 0x7fd4a81ac280 2024-03-24T10:40:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.095 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd4a000c670 con 0x7fd4a81ac280 2024-03-24T10:40:18.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.202 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4a80e2430 con 0x7fd4a81ac280 2024-03-24T10:40:18.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.202 7fd4977fe700 1 -- 172.21.15.73:0/3786378299 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4a81145f0 con 0x7fd4a81ac280 2024-03-24T10:40:18.204 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-24T10:40:18.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 >> v1:172.21.15.73:6816/43277 conn(0x7fd4840145b0 legacy=0x7fd484016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 msgr2=0x7fd4a80d9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 0x7fd4a80d9370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd4a80c2820 tx=0x7fd4a000ed70).stop 2024-03-24T10:40:18.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 shutdown_connections 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd4a81ac280 0x7fd4a80d9370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4a80df280 0x7fd4a81ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 --2- 172.21.15.73:0/3786378299 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd4a81abe30 0x7fd4a80d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 >> 172.21.15.73:0/3786378299 conn(0x7fd4a80c5640 msgr2=0x7fd4a81a63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 shutdown_connections 2024-03-24T10:40:18.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.204 7fd4ad6f0700 1 -- 172.21.15.73:0/3786378299 wait complete. 2024-03-24T10:40:18.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 Processor -- start 2024-03-24T10:40:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 -- start start 2024-03-24T10:40:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92a00f1e40 0x7f92a010e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a00f2290 0x7f92a010e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a00f91b0 con 0x7f92a00f1e40 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a010ee90 con 0x7f92a00f58a0 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f92a54bb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a01aa5e0 con 0x7f92a00f2290 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f929e2b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f929eab2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a00f2290 0x7f92a010e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f929e2b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60392/0 (socket says 172.21.15.73:60392) 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.342 7f929e2b1700 1 -- 172.21.15.73:0/563222643 learned_addr learned my addr 172.21.15.73:0/563222643 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 --2- 172.21.15.73:0/563222643 >> v2:172.21.15.73:3300/0 conn(0x7f92a00f1e40 0x7f92a010e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 -- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a00f2290 msgr2=0x7f92a010e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a00f2290 0x7f92a010e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 -- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 msgr2=0x7f92a00f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 -- 172.21.15.73:0/563222643 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a01aa790 con 0x7f92a00f1e40 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929e2b1700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929dab0700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00f1e40 0x7f92a010e230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f92a0103770 tx=0x7f929400ba20).ready entity=mon.0 client_cookie=5bcbcccdd2b8024e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929d2af700 1 -- 172.21.15.73:0/563222643 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92a01aa790 con 0x7f92a00f1e40 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929d2af700 1 -- 172.21.15.73:0/563222643 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400d570 con 0x7f92a00f1e40 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f929d2af700 1 -- 172.21.15.73:0/563222643 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f929400d940 con 0x7f92a00f1e40 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f92a54bb700 1 -- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00f1e40 msgr2=0x7f92a010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.343 7f92a54bb700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00f1e40 0x7f92a010e230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f92a0103770 tx=0x7f929400ba20).stop 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 -- 172.21.15.73:0/563222643 shutdown_connections 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a00f2290 0x7f92a010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00f58a0 0x7f92a00f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 --2- 172.21.15.73:0/563222643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00f1e40 0x7f92a010e230 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 -- 172.21.15.73:0/563222643 >> 172.21.15.73:0/563222643 conn(0x7f92a01139f0 msgr2=0x7f92a00f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 -- 172.21.15.73:0/563222643 shutdown_connections 2024-03-24T10:40:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.344 7f92a54bb700 1 -- 172.21.15.73:0/563222643 wait complete. 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 Processor -- start 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 -- start start 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 0x7f92a01b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 0x7f92a01b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00f01d0 con 0x7f92a00cbe40 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00d8c50 con 0x7f92a00cb3c0 2024-03-24T10:40:18.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f92a54bb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00be7b0 con 0x7f92a01b4c70 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929e2b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929dab0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 0x7f92a01b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929e2b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60404/0 (socket says 172.21.15.73:60404) 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929e2b1700 1 -- 172.21.15.73:0/162134922 learned_addr learned my addr 172.21.15.73:0/162134922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 0x7f92a01b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 -- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 msgr2=0x7f92a00cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 -- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 msgr2=0x7f92a01b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 0x7f92a01b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929eab2700 1 -- 172.21.15.73:0/162134922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00d9490 con 0x7f92a01b4c70 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929e2b1700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.367 7f929dab0700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 0x7f92a01b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f929eab2700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 0x7f92a01b50c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f92a00e6860 tx=0x7f929800ecf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92a00d9490 con 0x7f92a01b4c70 2024-03-24T10:40:18.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929800c830 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f929800f040 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f92a54bb700 1 -- 172.21.15.73:0/162134922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a01bbd30 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f92a54bb700 1 -- 172.21.15.73:0/162134922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a01bc110 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9298011070 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.368 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9298010040 con 0x7f92a01b4c70 2024-03-24T10:40:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.369 7f92a54bb700 1 -- 172.21.15.73:0/162134922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a00f0860 con 0x7f92a01b4c70 2024-03-24T10:40:18.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.372 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f929800c620 con 0x7f92a01b4c70 2024-03-24T10:40:18.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.506 7f92a54bb700 1 -- 172.21.15.73:0/162134922 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92a00a61a0 con 0x7f92a01b4c70 2024-03-24T10:40:18.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.506 7f928f7fe700 1 -- 172.21.15.73:0/162134922 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7f92a0114570 con 0x7f92a01b4c70 2024-03-24T10:40:18.508 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:18.508 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.507 7f92a54bb700 1 -- 172.21.15.73:0/162134922 >> v1:172.21.15.73:6816/43277 conn(0x7f927c0145b0 legacy=0x7f927c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.507 7f92a54bb700 1 -- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 msgr2=0x7f92a01b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.507 7f92a54bb700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 0x7f92a01b50c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f92a00e6860 tx=0x7f929800ecf0).stop 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.507 7f92a54bb700 1 -- 172.21.15.73:0/162134922 shutdown_connections 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.507 7f92a54bb700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f92a01b4c70 0x7f92a01b50c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.508 7f92a54bb700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92a00cb3c0 0x7f92a00cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.508 7f92a54bb700 1 --2- 172.21.15.73:0/162134922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a00cbe40 0x7f92a01b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.508 7f92a54bb700 1 -- 172.21.15.73:0/162134922 >> 172.21.15.73:0/162134922 conn(0x7f92a00de950 msgr2=0x7f92a00d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.508 7f92a54bb700 1 -- 172.21.15.73:0/162134922 shutdown_connections 2024-03-24T10:40:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.508 7f92a54bb700 1 -- 172.21.15.73:0/162134922 wait complete. 2024-03-24T10:40:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:18.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 Processor -- start 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 -- start start 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 0x7fb8940f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 0x7fb89410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8940f9230 con 0x7fb8940f1ec0 2024-03-24T10:40:18.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89410f0e0 con 0x7fb8940f5920 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb898fd5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8941ac680 con 0x7fb8940f2310 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.644 7fb891d9f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 0x7fb8940f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 0x7fb89410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb89159e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb8940f1ec0 0x7fb89410e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41946/0 (socket says 172.21.15.73:41946) 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb89159e700 1 -- 172.21.15.73:0/3279495750 learned_addr learned my addr 172.21.15.73:0/3279495750 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb890d9d700 1 -- 172.21.15.73:0/3279495750 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443939943 0 0) 0x7fb884001110 con 0x7fb8940f1ec0 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 -- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 msgr2=0x7fb8940f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 0x7fb8940f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 -- 172.21.15.73:0/3279495750 >> v1:172.21.15.73:6789/0 conn(0x7fb8940f1ec0 legacy=0x7fb89410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 -- 172.21.15.73:0/3279495750 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8941ac830 con 0x7fb8940f2310 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb891d9f700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 0x7fb8940f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb8925a0700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 0x7fb89410eab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb88c0032f0 tx=0x7fb88c009cc0).ready entity=mon.2 client_cookie=ecd0ead3dc922255 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb890d9d700 1 -- 172.21.15.73:0/3279495750 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8941ac830 con 0x7fb8940f2310 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb890d9d700 1 -- 172.21.15.73:0/3279495750 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00b880 con 0x7fb8940f2310 2024-03-24T10:40:18.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb890d9d700 1 -- 172.21.15.73:0/3279495750 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb88c00ba60 con 0x7fb8940f2310 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb898fd5700 1 -- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 msgr2=0x7fb89410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.645 7fb898fd5700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 0x7fb89410eab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb88c0032f0 tx=0x7fb88c009cc0).stop 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 -- 172.21.15.73:0/3279495750 shutdown_connections 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8940f2310 0x7fb89410eab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 --2- 172.21.15.73:0/3279495750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8940f5920 0x7fb8940f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 -- 172.21.15.73:0/3279495750 >> 172.21.15.73:0/3279495750 conn(0x7fb894113a70 msgr2=0x7fb8940f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 -- 172.21.15.73:0/3279495750 shutdown_connections 2024-03-24T10:40:18.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.646 7fb898fd5700 1 -- 172.21.15.73:0/3279495750 wait complete. 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.668 7fb898fd5700 1 Processor -- start 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.668 7fb898fd5700 1 -- start start 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 0x7fb8940cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 0x7fb8940cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940bc550 con 0x7fb8940cce10 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940cda00 con 0x7fb8941b53c0 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb898fd5700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940cbfd0 con 0x7fb8941b4940 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb891d9f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb89159e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 0x7fb8940cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb891d9f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42768/0 (socket says 172.21.15.73:42768) 2024-03-24T10:40:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb891d9f700 1 -- 172.21.15.73:0/3953391559 learned_addr learned my addr 172.21.15.73:0/3953391559 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 0x7fb8940cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 -- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 msgr2=0x7fb8941b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 -- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 msgr2=0x7fb8940cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 0x7fb8940cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 -- 172.21.15.73:0/3953391559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8941bbca0 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb89159e700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 0x7fb8940cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb891d9f700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb8925a0700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 0x7fb8940cd260 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb88c006fc0 tx=0x7fb88c006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb8941bbca0 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.669 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c011ab0 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.670 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8941bbea0 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.670 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb88c017040 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.670 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8941bc280 con 0x7fb8940cce10 2024-03-24T10:40:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.670 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb88c01c470 con 0x7fb8940cce10 2024-03-24T10:40:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.670 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb88c018030 con 0x7fb8940cce10 2024-03-24T10:40:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.671 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8940f08e0 con 0x7fb8940cce10 2024-03-24T10:40:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.674 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb88c0118a0 con 0x7fb8940cce10 2024-03-24T10:40:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.777 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8940c52b0 con 0x7fb8940cce10 2024-03-24T10:40:18.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.778 7fb882ffd700 1 -- 172.21.15.73:0/3953391559 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fb88c00b670 con 0x7fb8940cce10 2024-03-24T10:40:18.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:18.779 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:05.778914","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 >> v1:172.21.15.73:6816/43277 conn(0x7fb8700145b0 legacy=0x7fb870016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 msgr2=0x7fb8940cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 0x7fb8940cd260 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb88c006fc0 tx=0x7fb88c006c40).stop 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 shutdown_connections 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8940cce10 0x7fb8940cd260 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fb8941b4940 0x7fb8941b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 --2- 172.21.15.73:0/3953391559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb8941b53c0 0x7fb8940cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 >> 172.21.15.73:0/3953391559 conn(0x7fb8940dc6f0 msgr2=0x7fb8940d8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 shutdown_connections 2024-03-24T10:40:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.779 7fb898fd5700 1 -- 172.21.15.73:0/3953391559 wait complete. 2024-03-24T10:40:18.791 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-24T10:40:18.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:18.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.916 7f02eb062700 1 Processor -- start 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.916 7f02eb062700 1 -- start start 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 0x7f02e41a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 0x7f02e41a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e410bd60 con 0x7f02e40f5a10 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e40fa590 con 0x7f02e410b910 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e41a0c50 con 0x7f02e41a59d0 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e37fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f02e40f5a10 0x7f02e410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41950/0 (socket says 172.21.15.73:41950) 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e37fe700 1 -- 172.21.15.73:0/2960669235 learned_addr learned my addr 172.21.15.73:0/2960669235 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e3fff700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 0x7f02e41a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 0x7f02e41a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e27fc700 1 -- 172.21.15.73:0/2960669235 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216502874 0 0) 0x7f02d4001490 con 0x7f02e40f5a10 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e27fc700 1 -- 172.21.15.73:0/2960669235 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d0003270 con 0x7f02e40f5a10 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 -- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 msgr2=0x7f02e41a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:18.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 0x7f02e41a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 -- 172.21.15.73:0/2960669235 >> v1:172.21.15.73:6789/0 conn(0x7f02e40f5a10 legacy=0x7f02e410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 -- 172.21.15.73:0/2960669235 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e41a9470 con 0x7f02e410b910 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e3fff700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 0x7f02e41a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e2ffd700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 0x7f02e41a53a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f02e4103a10 tx=0x7f02d800ba50).ready entity=mon.1 client_cookie=436c7d53017efec0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e27fc700 1 -- 172.21.15.73:0/2960669235 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02e41a9470 con 0x7f02e410b910 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e27fc700 1 -- 172.21.15.73:0/2960669235 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800d570 con 0x7f02e410b910 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02e27fc700 1 -- 172.21.15.73:0/2960669235 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02d800d940 con 0x7f02e410b910 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 -- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 msgr2=0x7f02e41a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.917 7f02eb062700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 0x7f02e41a53a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f02e4103a10 tx=0x7f02d800ba50).stop 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 -- 172.21.15.73:0/2960669235 shutdown_connections 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41a59d0 0x7f02e41a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 --2- 172.21.15.73:0/2960669235 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e410b910 0x7f02e41a53a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 -- 172.21.15.73:0/2960669235 >> 172.21.15.73:0/2960669235 conn(0x7f02e4113a70 msgr2=0x7f02e40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 -- 172.21.15.73:0/2960669235 shutdown_connections 2024-03-24T10:40:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.918 7f02eb062700 1 -- 172.21.15.73:0/2960669235 wait complete. 2024-03-24T10:40:18.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.941 7f02eb062700 1 Processor -- start 2024-03-24T10:40:18.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.941 7f02eb062700 1 -- start start 2024-03-24T10:40:18.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 0x7f02e40c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e40c2cc0 0x7f02e41b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e40e6530 con 0x7f02e41b3370 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e40cdfd0 con 0x7f02e40c2cc0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e40d72c0 con 0x7f02e41b28f0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 0x7f02e40c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42794/0 (socket says 172.21.15.73:42794) 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 -- 172.21.15.73:0/2343079631 learned_addr learned my addr 172.21.15.73:0/2343079631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e3fff700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e40c2cc0 0x7f02e41b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 -- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e40c2cc0 msgr2=0x7f02e41b9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e40c2cc0 0x7f02e41b9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 -- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 msgr2=0x7f02e40c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 0x7f02e40c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 -- 172.21.15.73:0/2343079631 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40d6e10 con 0x7f02e41b28f0 2024-03-24T10:40:18.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e2ffd700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 0x7f02e40c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e37fe700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f02e40bc060 tx=0x7f02d400cb60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02e40d6e10 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4005bb0 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 -- 172.21.15.73:0/2343079631 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e40c3110 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02d4007110 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.942 7f02eb062700 1 -- 172.21.15.73:0/2343079631 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e41ba170 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.943 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f02d401a060 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.943 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f02d40055a0 con 0x7f02e41b28f0 2024-03-24T10:40:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.943 7f02eb062700 1 -- 172.21.15.73:0/2343079631 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e40f08e0 con 0x7f02e41b28f0 2024-03-24T10:40:18.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:18.947 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f02d40059a0 con 0x7f02e41b28f0 2024-03-24T10:40:19.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.080 7f02eb062700 1 -- 172.21.15.73:0/2343079631 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e40e2430 con 0x7f02e41b28f0 2024-03-24T10:40:19.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.080 7f02e0ff9700 1 -- 172.21.15.73:0/2343079631 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7f02e40fefc0 con 0x7f02e41b28f0 2024-03-24T10:40:19.081 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:19.081 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 >> v1:172.21.15.73:6816/43277 conn(0x7f02c40145b0 legacy=0x7f02c4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 msgr2=0x7f02e41b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f02e40bc060 tx=0x7f02d400cb60).stop 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 shutdown_connections 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02e40c2cc0 0x7f02e41b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f02e41b28f0 0x7f02e41b2d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 --2- 172.21.15.73:0/2343079631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02e41b3370 0x7f02e40c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 >> 172.21.15.73:0/2343079631 conn(0x7f02e40c5c30 msgr2=0x7f02e40c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 shutdown_connections 2024-03-24T10:40:19.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.081 7f02eb062700 1 -- 172.21.15.73:0/2343079631 wait complete. 2024-03-24T10:40:19.084 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:19.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:40:19.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.219 7fe852624700 1 Processor -- start 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.219 7fe852624700 1 -- start start 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 0x7fe84c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c0fa590 con 0x7fe84c0f5a10 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1a08a0 con 0x7fe84c10b740 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe852624700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1a0ad0 con 0x7fe84c10bb90 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84bbb1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 0x7fe84c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84b3b0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84b3b0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55730/0 (socket says 172.21.15.73:55730) 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60434/0 (socket says 172.21.15.73:60434) 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84b3b0700 1 -- 172.21.15.73:0/3066916072 learned_addr learned my addr 172.21.15.73:0/3066916072 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84bbb1700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 0x7fe84c1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42804/0 (socket says 172.21.15.73:42804) 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 -- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 msgr2=0x7fe84c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 --2- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 0x7fe84c1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 -- 172.21.15.73:0/3066916072 >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 msgr2=0x7fe84c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 --2- 172.21.15.73:0/3066916072 >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 -- 172.21.15.73:0/3066916072 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0f1890 con 0x7fe84c10b740 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84b3b0700 1 --2- 172.21.15.73:0/3066916072 >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84abaf700 1 --2- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe84c0f47c0 tx=0x7fe83c00ba20).ready entity=mon.1 client_cookie=634b8888dab4ff0d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84a3ae700 1 -- 172.21.15.73:0/3066916072 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe84c0f1890 con 0x7fe84c10b740 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.220 7fe84a3ae700 1 -- 172.21.15.73:0/3066916072 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00d570 con 0x7fe84c10b740 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe84a3ae700 1 -- 172.21.15.73:0/3066916072 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe83c00d940 con 0x7fe84c10b740 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 -- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 msgr2=0x7fe84c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 --2- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe84c0f47c0 tx=0x7fe83c00ba20).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 -- 172.21.15.73:0/3066916072 shutdown_connections 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 --2- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c10bb90 0x7fe84c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 --2- 172.21.15.73:0/3066916072 >> v2:172.21.15.73:3300/0 conn(0x7fe84c0f5a10 0x7fe84c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 --2- 172.21.15.73:0/3066916072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c10b740 0x7fe84c19fc40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 -- 172.21.15.73:0/3066916072 >> 172.21.15.73:0/3066916072 conn(0x7fe84c113a70 msgr2=0x7fe84c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 -- 172.21.15.73:0/3066916072 shutdown_connections 2024-03-24T10:40:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.221 7fe852624700 1 -- 172.21.15.73:0/3066916072 wait complete. 2024-03-24T10:40:19.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 Processor -- start 2024-03-24T10:40:19.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 -- start start 2024-03-24T10:40:19.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 0x7fe84c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c0cca00 0x7fe84c1b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0c1bc0 con 0x7fe84c0cce50 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0cfea0 con 0x7fe84c0cca00 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe852624700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0cf610 con 0x7fe84c0cfa50 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84b3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 0x7fe84c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84bbb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84b3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 0x7fe84c0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42818/0 (socket says 172.21.15.73:42818) 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84abaf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c0cca00 0x7fe84c1b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84b3b0700 1 -- 172.21.15.73:0/3043042696 learned_addr learned my addr 172.21.15.73:0/3043042696 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.244 7fe84bbb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55746/0 (socket says 172.21.15.73:55746) 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 -- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 msgr2=0x7fe84c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 0x7fe84c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 -- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c0cca00 msgr2=0x7fe84c1b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c0cca00 0x7fe84c1b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 -- 172.21.15.73:0/3043042696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c1b5110 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe84bbb1700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe84c0d0050 tx=0x7fe84400ed50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe84c1b5110 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84400c7b0 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe852624700 1 -- 172.21.15.73:0/3043042696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c1bbcb0 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe84400f040 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.245 7fe852624700 1 -- 172.21.15.73:0/3043042696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c1bbeb0 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.246 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe844022060 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.246 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe844010040 con 0x7fe84c0cce50 2024-03-24T10:40:19.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.246 7fe852624700 1 -- 172.21.15.73:0/3043042696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c0d1590 con 0x7fe84c0cce50 2024-03-24T10:40:19.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.249 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe84400c5a0 con 0x7fe84c0cce50 2024-03-24T10:40:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.383 7fe852624700 1 -- 172.21.15.73:0/3043042696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe84c0f08e0 con 0x7fe84c0cce50 2024-03-24T10:40:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.383 7fe848bab700 1 -- 172.21.15.73:0/3043042696 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1704 (secure 0 0 0) 0x7fe84c1145f0 con 0x7fe84c0cce50 2024-03-24T10:40:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:19.385 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24 10:40:04.777574","modified":"2024-03-24 10:40:06.781227","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6817/3503607711","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":3503607711}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.384 7fe852624700 1 -- 172.21.15.73:0/3043042696 >> v1:172.21.15.73:6816/43277 conn(0x7fe82c0145b0 legacy=0x7fe82c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.384 7fe852624700 1 -- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 msgr2=0x7fe84c1b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.384 7fe852624700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe84c0d0050 tx=0x7fe84400ed50).stop 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 -- 172.21.15.73:0/3043042696 shutdown_connections 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe84c0cce50 0x7fe84c1b4ae0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fe84c0cfa50 0x7fe84c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 --2- 172.21.15.73:0/3043042696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe84c0cca00 0x7fe84c1b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 -- 172.21.15.73:0/3043042696 >> 172.21.15.73:0/3043042696 conn(0x7fe84c1a7cb0 msgr2=0x7fe84c1a85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 -- 172.21.15.73:0/3043042696 shutdown_connections 2024-03-24T10:40:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.385 7fe852624700 1 -- 172.21.15.73:0/3043042696 wait complete. 2024-03-24T10:40:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2024-03-24T10:40:19.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 Processor -- start 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 -- start start 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 0x7f66f41a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 0x7f66f41ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40f9230 con 0x7f66f40f5920 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f40f24e0 con 0x7f66f40f2090 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66fc1ff700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41ac720 con 0x7f66f41a8c80 2024-03-24T10:40:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66f3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 0x7f66f41a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66f8ffa700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f66f40f5920 0x7f66f40f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41964/0 (socket says 172.21.15.73:41964) 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66f97fb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 0x7f66f41ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.521 7f66f8ffa700 1 -- 172.21.15.73:0/1374180250 learned_addr learned my addr 172.21.15.73:0/1374180250 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f97fb700 1 -- 172.21.15.73:0/1374180250 >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 msgr2=0x7f66f41a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f97fb700 1 --2- 172.21.15.73:0/1374180250 >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 0x7f66f41a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f97fb700 1 -- 172.21.15.73:0/1374180250 >> v1:172.21.15.73:6789/0 conn(0x7f66f40f5920 legacy=0x7f66f40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f97fb700 1 -- 172.21.15.73:0/1374180250 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f41ac8d0 con 0x7f66f41a8c80 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f3fff700 1 --2- 172.21.15.73:0/1374180250 >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 0x7f66f41a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f97fb700 1 --2- 172.21.15.73:0/1374180250 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 0x7f66f41ab0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f66ec0032f0 tx=0x7f66ec009c90).ready entity=mon.2 client_cookie=40a61503acc4266c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f37fe700 1 -- 172.21.15.73:0/1374180250 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66f41ac8d0 con 0x7f66f41a8c80 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f37fe700 1 -- 172.21.15.73:0/1374180250 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00b880 con 0x7f66f41a8c80 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66f37fe700 1 -- 172.21.15.73:0/1374180250 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66ec00ba60 con 0x7f66f41a8c80 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66fc1ff700 1 -- 172.21.15.73:0/1374180250 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 msgr2=0x7f66f41ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.522 7f66fc1ff700 1 --2- 172.21.15.73:0/1374180250 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 0x7f66f41ab0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f66ec0032f0 tx=0x7f66ec009c90).stop 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 -- 172.21.15.73:0/1374180250 shutdown_connections 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 --2- 172.21.15.73:0/1374180250 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41a8c80 0x7f66f41ab0e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 --2- 172.21.15.73:0/1374180250 >> v2:172.21.15.73:3300/0 conn(0x7f66f40f2090 0x7f66f41a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 -- 172.21.15.73:0/1374180250 >> 172.21.15.73:0/1374180250 conn(0x7f66f4113a70 msgr2=0x7f66f40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 -- 172.21.15.73:0/1374180250 shutdown_connections 2024-03-24T10:40:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.523 7f66fc1ff700 1 -- 172.21.15.73:0/1374180250 wait complete. 2024-03-24T10:40:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.545 7f66fc1ff700 1 Processor -- start 2024-03-24T10:40:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.545 7f66fc1ff700 1 -- start start 2024-03-24T10:40:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 0x7f66f41b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40bc960 con 0x7f66f40c7d40 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40cb4d0 con 0x7f66f41b1f50 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41b5680 con 0x7f66f41b23a0 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f97fb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 0x7f66f41b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:60452/0 (socket says 172.21.15.73:60452) 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f97fb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 0x7f66f41b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42830/0 (socket says 172.21.15.73:42830) 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f3fff700 1 -- 172.21.15.73:0/2145868929 learned_addr learned my addr 172.21.15.73:0/2145868929 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55768/0 (socket says 172.21.15.73:55768) 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 -- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 msgr2=0x7f66f41b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 0x7f66f41b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 -- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 msgr2=0x7f66f41b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 -- 172.21.15.73:0/2145868929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f41b58b0 con 0x7f66f40c7d40 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f3fff700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f8ffa700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f66e8000bc0 tx=0x7f66e800c7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66f41b58b0 con 0x7f66f40c7d40 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80070d0 con 0x7f66f40c7d40 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.546 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41bc0b0 con 0x7f66f40c7d40 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.547 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66e8005620 con 0x7f66f40c7d40 2024-03-24T10:40:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.547 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41bc490 con 0x7f66f40c7d40 2024-03-24T10:40:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.547 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f66e8005820 con 0x7f66f40c7d40 2024-03-24T10:40:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.547 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f66e8014610 con 0x7f66f40c7d40 2024-03-24T10:40:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.547 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f40f08e0 con 0x7f66f40c7d40 2024-03-24T10:40:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.551 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f66e800cdc0 con 0x7f66f40c7d40 2024-03-24T10:40:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.656 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f40cf320 con 0x7f66f40c7d40 2024-03-24T10:40:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.657 7f66f1ffb700 1 -- 172.21.15.73:0/2145868929 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f66e8000c30 con 0x7f66f40c7d40 2024-03-24T10:40:19.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:19.658 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:05.778914","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-24 10:40:02.846332","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-24 10:40:03.756602","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 >> v1:172.21.15.73:6816/43277 conn(0x7f66dc0145b0 legacy=0x7f66dc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 msgr2=0x7f66f41b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f66e8000bc0 tx=0x7f66e800c7b0).stop 2024-03-24T10:40:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 shutdown_connections 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f41b23a0 0x7f66f41b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f40c7d40 0x7f66f41b1920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 --2- 172.21.15.73:0/2145868929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f41b1f50 0x7f66f41b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 >> 172.21.15.73:0/2145868929 conn(0x7f66f40bd8c0 msgr2=0x7f66f40c16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 shutdown_connections 2024-03-24T10:40:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.658 7f66fc1ff700 1 -- 172.21.15.73:0/2145868929 wait complete. 2024-03-24T10:40:19.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.797 7f9d3cad8700 1 Processor -- start 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.797 7f9d3cad8700 1 -- start start 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3cad8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 0x7f9d3810b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3cad8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 0x7f9d3819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3cad8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d381a0a60 con 0x7f9d3810bb80 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3cad8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380fa580 con 0x7f9d3810b730 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3cad8700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381a0c80 con 0x7f9d380f5a00 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 0x7f9d3810b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d36051700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9d3810bb80 0x7f9d381a0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41970/0 (socket says 172.21.15.73:41970) 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3504f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 0x7f9d3819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d36051700 1 -- 172.21.15.73:0/3460906574 learned_addr learned my addr 172.21.15.73:0/3460906574 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 -- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 msgr2=0x7f9d3819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 0x7f9d3819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 -- 172.21.15.73:0/3460906574 >> v1:172.21.15.73:6789/0 conn(0x7f9d3810bb80 legacy=0x7f9d381a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 -- 172.21.15.73:0/3460906574 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d381a93c0 con 0x7f9d380f5a00 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d3504f700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 0x7f9d3819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.798 7f9d35850700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 0x7f9d3810b100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9d30001700 tx=0x7f9d30001400).ready entity=mon.2 client_cookie=994883a6ea56ec0c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3484e700 1 -- 172.21.15.73:0/3460906574 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d381a93c0 con 0x7f9d380f5a00 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3484e700 1 -- 172.21.15.73:0/3460906574 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c00d4a0 con 0x7f9d380f5a00 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3484e700 1 -- 172.21.15.73:0/3460906574 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d2c00d870 con 0x7f9d380f5a00 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 -- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 msgr2=0x7f9d3810b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 0x7f9d3810b100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9d30001700 tx=0x7f9d30001400).stop 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 -- 172.21.15.73:0/3460906574 shutdown_connections 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380f5a00 0x7f9d3810b100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 --2- 172.21.15.73:0/3460906574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d3810b730 0x7f9d3819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 -- 172.21.15.73:0/3460906574 >> 172.21.15.73:0/3460906574 conn(0x7f9d38113a60 msgr2=0x7f9d380f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 -- 172.21.15.73:0/3460906574 shutdown_connections 2024-03-24T10:40:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.799 7f9d3cad8700 1 -- 172.21.15.73:0/3460906574 wait complete. 2024-03-24T10:40:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.821 7f9d3cad8700 1 Processor -- start 2024-03-24T10:40:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.821 7f9d3cad8700 1 -- start start 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 0x7f9d381b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 0x7f9d381b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380d7560 con 0x7f9d380d5a40 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380de0c0 con 0x7f9d381b4990 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3cad8700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380dda70 con 0x7f9d380d4fc0 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:42856/0 (socket says 172.21.15.73:42856) 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d36051700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 0x7f9d381b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 -- 172.21.15.73:0/1379166713 learned_addr learned my addr 172.21.15.73:0/1379166713 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3504f700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 0x7f9d381b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 -- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 msgr2=0x7f9d381b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 0x7f9d381b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 -- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 msgr2=0x7f9d381b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 0x7f9d381b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 -- 172.21.15.73:0/1379166713 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380dd660 con 0x7f9d380d4fc0 2024-03-24T10:40:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d3504f700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 0x7f9d381b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d36051700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 0x7f9d381b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d35850700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9d380dae60 tx=0x7f9d2c00a040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d380dd660 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.822 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c013ab0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.823 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d381bbad0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.823 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d2c01e400 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.823 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d381bbeb0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.823 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9d2c0113c0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.823 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9d2c017b50 con 0x7f9d380d4fc0 2024-03-24T10:40:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.824 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380f08d0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.827 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9d2c0138a0 con 0x7f9d380d4fc0 2024-03-24T10:40:19.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:19.963 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d381aea80 con 0x7f9d380d4fc0 2024-03-24T10:40:20.183 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-03-24 10:40:20.182 7f1d1ca5e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-24T10:40:20.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.184 7f9d26ffd700 1 -- 172.21.15.73:0/1379166713 <== mon.2 v2:172.21.15.73:3302/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d2c00d290 con 0x7f9d380d4fc0 2024-03-24T10:40:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 >> v1:172.21.15.73:6816/43277 conn(0x7f9d140145b0 legacy=0x7f9d14016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 msgr2=0x7f9d380d5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9d380dae60 tx=0x7f9d2c00a040).stop 2024-03-24T10:40:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 shutdown_connections 2024-03-24T10:40:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d381b4990 0x7f9d381b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f9d380d4fc0 0x7f9d380d5410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 --2- 172.21.15.73:0/1379166713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d380d5a40 0x7f9d381b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 >> 172.21.15.73:0/1379166713 conn(0x7f9d380c52b0 msgr2=0x7f9d381a83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 shutdown_connections 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.186 7f9d3cad8700 1 -- 172.21.15.73:0/1379166713 wait complete. 2024-03-24T10:40:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-24T10:40:20.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-24T10:40:20.206 INFO:tasks.ceph.mds.a.smithi073.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-03-24T10:40:20.258 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 Processor -- start 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 -- start start 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80fa270 con 0x7f66f810c950 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80f95a0 con 0x7f66f810cda0 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66fdc91700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80f24d0 con 0x7f66f80f5900 2024-03-24T10:40:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f7271700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f626f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f6a70700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f6a70700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36354/0 (socket says 172.21.15.73:36354) 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f626f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57460/0 (socket says 172.21.15.73:57460) 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f7271700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57756/0 (socket says 172.21.15.73:57756) 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.330 7f66f6a70700 1 -- 172.21.15.73:0/1616821376 learned_addr learned my addr 172.21.15.73:0/1616821376 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 -- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 msgr2=0x7f66f80f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 -- 172.21.15.73:0/1616821376 >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 msgr2=0x7f66f80f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 --2- 172.21.15.73:0/1616821376 >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 -- 172.21.15.73:0/1616821376 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80f2700 con 0x7f66f80f5900 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f626f700 1 --2- 172.21.15.73:0/1616821376 >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f7271700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:20.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f6a70700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f66f81133e0 tx=0x7f66ec009a30).ready entity=mon.2 client_cookie=95bd3b631e19fdc server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f5a6e700 1 -- 172.21.15.73:0/1616821376 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66f80f2700 con 0x7f66f80f5900 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f5a6e700 1 -- 172.21.15.73:0/1616821376 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00f510 con 0x7f66f80f5900 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66f5a6e700 1 -- 172.21.15.73:0/1616821376 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66ec00f6f0 con 0x7f66f80f5900 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66fdc91700 1 -- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 msgr2=0x7f66f810c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.331 7f66fdc91700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f66f81133e0 tx=0x7f66ec009a30).stop 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 -- 172.21.15.73:0/1616821376 shutdown_connections 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f810cda0 0x7f66f80f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 --2- 172.21.15.73:0/1616821376 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f80f5900 0x7f66f810c320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 --2- 172.21.15.73:0/1616821376 >> v2:172.21.15.73:3300/0 conn(0x7f66f810c950 0x7f66f80f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 -- 172.21.15.73:0/1616821376 >> 172.21.15.73:0/1616821376 conn(0x7f66f8113a50 msgr2=0x7f66f80f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 -- 172.21.15.73:0/1616821376 shutdown_connections 2024-03-24T10:40:20.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.332 7f66fdc91700 1 -- 172.21.15.73:0/1616821376 wait complete. 2024-03-24T10:40:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.354 7f66fdc91700 1 Processor -- start 2024-03-24T10:40:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.354 7f66fdc91700 1 -- start start 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80c4470 con 0x7f66f81b4700 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80caa40 con 0x7f66f81ad670 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80ce220 con 0x7f66f81ae0f0 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f7271700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f626f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57760/0 (socket says 172.21.15.73:57760) 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f7271700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57476/0 (socket says 172.21.15.73:57476) 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 -- 172.21.15.73:0/356101017 learned_addr learned my addr 172.21.15.73:0/356101017 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f626f700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36362/0 (socket says 172.21.15.73:36362) 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 -- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 msgr2=0x7f66f81b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 -- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 msgr2=0x7f66f81b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 -- 172.21.15.73:0/356101017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f81bb7c0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f626f700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f7271700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66f6a70700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f66f81133e0 tx=0x7f66ec0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66f81bb7c0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec011610 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.355 7f66fdc91700 1 -- 172.21.15.73:0/356101017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f81bb9c0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.356 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66ec0119e0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.356 7f66fdc91700 1 -- 172.21.15.73:0/356101017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f81bbda0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.356 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f66ec011be0 con 0x7f66f81ad670 2024-03-24T10:40:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.356 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f66ec001b90 con 0x7f66f81ad670 2024-03-24T10:40:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.357 7f66fdc91700 1 -- 172.21.15.73:0/356101017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80f08c0 con 0x7f66f81ad670 2024-03-24T10:40:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.360 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f66ec011400 con 0x7f66f81ad670 2024-03-24T10:40:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:20.496 7f66fdc91700 1 -- 172.21.15.73:0/356101017 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f66f81ae7d0 con 0x7f66f81ad670 2024-03-24T10:40:21.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.194 7f66e7fff700 1 -- 172.21.15.73:0/356101017 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f66ec00f300 con 0x7f66f81ad670 2024-03-24T10:40:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 >> v1:172.21.15.73:6816/43277 conn(0x7f66d40145b0 legacy=0x7f66d4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 msgr2=0x7f66f81adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f66f81133e0 tx=0x7f66ec0068c0).stop 2024-03-24T10:40:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 shutdown_connections 2024-03-24T10:40:21.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f81b4700 0x7f66f81b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66f81ad670 0x7f66f81adac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 --2- 172.21.15.73:0/356101017 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f66f81ae0f0 0x7f66f81b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 >> 172.21.15.73:0/356101017 conn(0x7f66f80c5550 msgr2=0x7f66f80c2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:21.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 shutdown_connections 2024-03-24T10:40:21.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.196 7f66fdc91700 1 -- 172.21.15.73:0/356101017 wait complete. 2024-03-24T10:40:21.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-24T10:40:21.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 Processor -- start 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 -- start start 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 0x7fdbf410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 0x7fdbf41a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf41a0a60 con 0x7fdbf410b730 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40fa580 con 0x7fdbf410bb80 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbfa38c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41a0c80 con 0x7fdbf40f5a00 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3086700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 0x7fdbf410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.398 7fdbf2885700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdbf410b730 0x7fdbf419fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60242/0 (socket says 172.21.15.73:60242) 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 0x7fdbf41a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf2885700 1 -- 172.21.15.73:0/1617610046 learned_addr learned my addr 172.21.15.73:0/1617610046 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 -- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 msgr2=0x7fdbf410b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 0x7fdbf410b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 -- 172.21.15.73:0/1617610046 >> v1:172.21.15.73:6789/0 conn(0x7fdbf410b730 legacy=0x7fdbf419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf2084700 1 -- 172.21.15.73:0/1617610046 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438666921 0 0) 0x7fdbe4001110 con 0x7fdbf410b730 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 -- 172.21.15.73:0/1617610046 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf41a93c0 con 0x7fdbf410bb80 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3086700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 0x7fdbf410b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf3887700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 0x7fdbf41a0430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdbf4103a00 tx=0x7fdbec009d70).ready entity=mon.1 client_cookie=881e79b1f1179a9f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf2084700 1 -- 172.21.15.73:0/1617610046 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbf41a93c0 con 0x7fdbf410bb80 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf2084700 1 -- 172.21.15.73:0/1617610046 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00b7c0 con 0x7fdbf410bb80 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbf2084700 1 -- 172.21.15.73:0/1617610046 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbec00b9a0 con 0x7fdbf410bb80 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbfa38c700 1 -- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 msgr2=0x7fdbf41a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.399 7fdbfa38c700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 0x7fdbf41a0430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdbf4103a00 tx=0x7fdbec009d70).stop 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 -- 172.21.15.73:0/1617610046 shutdown_connections 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf410bb80 0x7fdbf41a0430 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 --2- 172.21.15.73:0/1617610046 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40f5a00 0x7fdbf410b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 -- 172.21.15.73:0/1617610046 >> 172.21.15.73:0/1617610046 conn(0x7fdbf4113a60 msgr2=0x7fdbf40f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:21.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 -- 172.21.15.73:0/1617610046 shutdown_connections 2024-03-24T10:40:21.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.400 7fdbfa38c700 1 -- 172.21.15.73:0/1617610046 wait complete. 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 Processor -- start 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 -- start start 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 0x7fdbf41afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 0x7fdbf41b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40dc5e0 con 0x7fdbf40d38c0 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40db690 con 0x7fdbf40dc190 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbfa38c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40db8c0 con 0x7fdbf40d3d10 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbf3086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:21.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbf3086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57776/0 (socket says 172.21.15.73:57776) 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbf3887700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 0x7fdbf41b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbf2885700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 0x7fdbf41afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.423 7fdbf3086700 1 -- 172.21.15.73:0/3135585096 learned_addr learned my addr 172.21.15.73:0/3135585096 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 -- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 msgr2=0x7fdbf41b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 0x7fdbf41b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 -- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 msgr2=0x7fdbf41afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 0x7fdbf41afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 -- 172.21.15.73:0/3135585096 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf41b0750 con 0x7fdbf40dc190 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3887700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 0x7fdbf41b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf2885700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 0x7fdbf41afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf3086700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdbf40c44f0 tx=0x7fdbe800bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbf41b0750 con 0x7fdbf40dc190 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe800c9a0 con 0x7fdbf40dc190 2024-03-24T10:40:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf41b0a70 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdbe800f040 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.424 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41b74d0 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.425 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdbe8011070 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.425 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fdbe8010040 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.425 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf40f08d0 con 0x7fdbf40dc190 2024-03-24T10:40:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.428 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdbe800c5a0 con 0x7fdbf40dc190 2024-03-24T10:40:21.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:21.534 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbf41aa380 con 0x7fdbf40dc190 2024-03-24T10:40:22.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.199 7fdbf0881700 1 -- 172.21.15.73:0/3135585096 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdbe8000c30 con 0x7fdbf40dc190 2024-03-24T10:40:22.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.204 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 >> v1:172.21.15.73:6816/43277 conn(0x7fdbd40145b0 legacy=0x7fdbd4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.204 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 msgr2=0x7fdbf40d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.204 7fdbfa38c700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdbf40c44f0 tx=0x7fdbe800bf70).stop 2024-03-24T10:40:22.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 shutdown_connections 2024-03-24T10:40:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fdbf40d3d10 0x7fdbf41b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdbf40dc190 0x7fdbf40d3290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 --2- 172.21.15.73:0/3135585096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbf40d38c0 0x7fdbf41afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 >> 172.21.15.73:0/3135585096 conn(0x7fdbf40e0f40 msgr2=0x7fdbf40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:22.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.206 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 shutdown_connections 2024-03-24T10:40:22.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.208 7fdbfa38c700 1 -- 172.21.15.73:0/3135585096 wait complete. 2024-03-24T10:40:22.210 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-03-24T10:40:22.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 Processor -- start 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 -- start start 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36b00f5a00 0x7f36b010b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 0x7f36b019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b01a0a60 con 0x7f36b010bb80 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00fa580 con 0x7f36b00f5a00 2024-03-24T10:40:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36b4f3b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01a0c80 con 0x7f36b010b730 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.353 7f36ad363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 0x7f36b019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36b00f5a00 0x7f36b010b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36ad363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 0x7f36b019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57780/0 (socket says 172.21.15.73:57780) 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36b00f5a00 0x7f36b010b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57498/0 (socket says 172.21.15.73:57498) 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36ad363700 1 -- 172.21.15.73:0/618836885 learned_addr learned my addr 172.21.15.73:0/618836885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36ae365700 1 --1- 172.21.15.73:0/618836885 >> v1:172.21.15.73:6789/0 conn(0x7f36b010bb80 0x7f36b01a0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60258/0 (socket says 172.21.15.73:60258) 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 -- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 msgr2=0x7f36b019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 --2- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 0x7f36b019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 -- 172.21.15.73:0/618836885 >> v1:172.21.15.73:6789/0 conn(0x7f36b010bb80 legacy=0x7f36b01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36acb62700 1 -- 172.21.15.73:0/618836885 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367095587 0 0) 0x7f36a8001490 con 0x7f36b010bb80 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 -- 172.21.15.73:0/618836885 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b01a93c0 con 0x7f36b00f5a00 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36adb64700 1 --2- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b00f5a00 0x7f36b010b100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f36b010f910 tx=0x7f369800ba20).ready entity=mon.0 client_cookie=832cbc2dcf3b7c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36acb62700 1 -- 172.21.15.73:0/618836885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36b01a93c0 con 0x7f36b00f5a00 2024-03-24T10:40:22.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36acb62700 1 -- 172.21.15.73:0/618836885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800d5c0 con 0x7f36b00f5a00 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36acb62700 1 -- 172.21.15.73:0/618836885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f369800d990 con 0x7f36b00f5a00 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36b4f3b700 1 -- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b00f5a00 msgr2=0x7f36b010b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.354 7f36b4f3b700 1 --2- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b00f5a00 0x7f36b010b100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f36b010f910 tx=0x7f369800ba20).stop 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 -- 172.21.15.73:0/618836885 shutdown_connections 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 --2- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b00f5a00 0x7f36b010b100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 --2- 172.21.15.73:0/618836885 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b010b730 0x7f36b019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 -- 172.21.15.73:0/618836885 >> 172.21.15.73:0/618836885 conn(0x7f36b0113a60 msgr2=0x7f36b00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 -- 172.21.15.73:0/618836885 shutdown_connections 2024-03-24T10:40:22.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.355 7f36b4f3b700 1 -- 172.21.15.73:0/618836885 wait complete. 2024-03-24T10:40:22.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.377 7f36b4f3b700 1 Processor -- start 2024-03-24T10:40:22.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.377 7f36b4f3b700 1 -- start start 2024-03-24T10:40:22.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 0x7f36b01ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 0x7f36b01b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00dd050 con 0x7f36b01adc30 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00c3e10 con 0x7f36b00d9730 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36b4f3b700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01ae080 con 0x7f36b01ad1b0 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36adb64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 0x7f36b01b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ad363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 0x7f36b01ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36adb64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57796/0 (socket says 172.21.15.73:57796) 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ad363700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 0x7f36b01ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36392/0 (socket says 172.21.15.73:36392) 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36adb64700 1 -- 172.21.15.73:0/1212614844 learned_addr learned my addr 172.21.15.73:0/1212614844 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 -- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 msgr2=0x7f36b01ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 0x7f36b01ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 -- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 msgr2=0x7f36b00d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 -- 172.21.15.73:0/1212614844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00dd290 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36adb64700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36ae365700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 0x7f36b01b7c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f36b00ce7b0 tx=0x7f36a800c960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.378 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36b00dd290 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8005af0 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b01b09b0 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36a80070d0 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b01b8280 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f36a801a070 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.379 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2799+0+0 (secure 0 0 0) 0x7f36a80145a0 con 0x7f36b01adc30 2024-03-24T10:40:22.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.380 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00f08d0 con 0x7f36b01adc30 2024-03-24T10:40:22.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.383 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f36a80058e0 con 0x7f36b01adc30 2024-03-24T10:40:22.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:22.488 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36b01aae90 con 0x7f36b01adc30 2024-03-24T10:40:23.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.218 7f36a6ffd700 1 -- 172.21.15.73:0/1212614844 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36b01145e0 con 0x7f36b01adc30 2024-03-24T10:40:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.226 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 >> v1:172.21.15.73:6816/43277 conn(0x7f36940145b0 legacy=0x7f3694016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.226 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 msgr2=0x7f36b01b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.226 7f36b4f3b700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 0x7f36b01b7c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f36b00ce7b0 tx=0x7f36a800c960).stop 2024-03-24T10:40:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 shutdown_connections 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36b01adc30 0x7f36b01b7c50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f36b00d9730 0x7f36b00d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 --2- 172.21.15.73:0/1212614844 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f36b01ad1b0 0x7f36b01ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 >> 172.21.15.73:0/1212614844 conn(0x7f36b00e0880 msgr2=0x7f36b00ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.227 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 shutdown_connections 2024-03-24T10:40:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.228 7f36b4f3b700 1 -- 172.21.15.73:0/1212614844 wait complete. 2024-03-24T10:40:23.232 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-03-24T10:40:23.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-24T10:40:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 Processor -- start 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 -- start start 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 0x7fef1010b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef101a09e0 con 0x7fef1010bb00 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef100fa500 con 0x7fef100f5980 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.376 7fef16966700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef101a0c00 con 0x7fef1010b6b0 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57806/0 (socket says 172.21.15.73:57806) 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 -- 172.21.15.73:0/102094502 learned_addr learned my addr 172.21.15.73:0/102094502 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0fdec700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fef1010bb00 0x7fef101a01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60270/0 (socket says 172.21.15.73:60270) 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0f5eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 0x7fef1010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0e5e9700 1 -- 172.21.15.73:0/102094502 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164125804 0 0) 0x7fef08001490 con 0x7fef1010bb00 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 -- 172.21.15.73:0/102094502 >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 msgr2=0x7fef1010b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 --2- 172.21.15.73:0/102094502 >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 0x7fef1010b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 -- 172.21.15.73:0/102094502 >> v1:172.21.15.73:6789/0 conn(0x7fef1010bb00 legacy=0x7fef101a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 -- 172.21.15.73:0/102094502 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100f1800 con 0x7fef1010b6b0 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0f5eb700 1 --2- 172.21.15.73:0/102094502 >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 0x7fef1010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0edea700 1 --2- 172.21.15.73:0/102094502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fef10103980 tx=0x7fef04009a00).ready entity=mon.1 client_cookie=92bb347ab5fa7e9c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0e5e9700 1 -- 172.21.15.73:0/102094502 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef100f1800 con 0x7fef1010b6b0 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0e5e9700 1 -- 172.21.15.73:0/102094502 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0400f510 con 0x7fef1010b6b0 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.377 7fef0e5e9700 1 -- 172.21.15.73:0/102094502 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef0400f6f0 con 0x7fef1010b6b0 2024-03-24T10:40:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 -- 172.21.15.73:0/102094502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 msgr2=0x7fef1019fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 --2- 172.21.15.73:0/102094502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fef10103980 tx=0x7fef04009a00).stop 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 -- 172.21.15.73:0/102094502 shutdown_connections 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 --2- 172.21.15.73:0/102094502 >> v2:172.21.15.73:3300/0 conn(0x7fef100f5980 0x7fef1010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 --2- 172.21.15.73:0/102094502 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef1010b6b0 0x7fef1019fbb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 -- 172.21.15.73:0/102094502 >> 172.21.15.73:0/102094502 conn(0x7fef101139e0 msgr2=0x7fef100f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 -- 172.21.15.73:0/102094502 shutdown_connections 2024-03-24T10:40:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.378 7fef16966700 1 -- 172.21.15.73:0/102094502 wait complete. 2024-03-24T10:40:23.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.400 7fef16966700 1 Processor -- start 2024-03-24T10:40:23.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 -- start start 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fef101abb80 0x7fef100cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 0x7fef100cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100d68f0 con 0x7fef101abfd0 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100c5180 con 0x7fef100bab10 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef16966700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ce040 con 0x7fef101abb80 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0f5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0fdec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 0x7fef100cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0f5eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57808/0 (socket says 172.21.15.73:57808) 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0f5eb700 1 -- 172.21.15.73:0/1169132042 learned_addr learned my addr 172.21.15.73:0/1169132042 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0edea700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fef101abb80 0x7fef100cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.401 7fef0fdec700 1 -- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fef101abb80 msgr2=0x7fef100cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0fdec700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fef101abb80 0x7fef100cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0fdec700 1 -- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 msgr2=0x7fef101ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0fdec700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0fdec700 1 -- 172.21.15.73:0/1169132042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef101b9410 con 0x7fef101abfd0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0f5eb700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0fdec700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 0x7fef100cda10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fef08001250 tx=0x7fef0800c980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef101b9410 con 0x7fef101abfd0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08005af0 con 0x7fef101abfd0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef16966700 1 -- 172.21.15.73:0/1169132042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef101b9610 con 0x7fef101abfd0 2024-03-24T10:40:23.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef080070d0 con 0x7fef101abfd0 2024-03-24T10:40:23.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef16966700 1 -- 172.21.15.73:0/1169132042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef101b99f0 con 0x7fef101abfd0 2024-03-24T10:40:23.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fef080072d0 con 0x7fef101abfd0 2024-03-24T10:40:23.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.402 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fef0800bd90 con 0x7fef101abfd0 2024-03-24T10:40:23.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.403 7fef16966700 1 -- 172.21.15.73:0/1169132042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef100f0850 con 0x7fef101abfd0 2024-03-24T10:40:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.406 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fef080058e0 con 0x7fef101abfd0 2024-03-24T10:40:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.512 7fef16966700 1 -- 172.21.15.73:0/1169132042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fef100eff20 con 0x7fef101abfd0 2024-03-24T10:40:23.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.515 7fef0cde6700 1 -- 172.21.15.73:0/1169132042 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef10114560 con 0x7fef101abfd0 2024-03-24T10:40:23.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 >> v1:172.21.15.73:6816/43277 conn(0x7feef00145b0 legacy=0x7feef0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 msgr2=0x7fef100cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 0x7fef100cda10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fef08001250 tx=0x7fef0800c980).stop 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 shutdown_connections 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef101abfd0 0x7fef100cda10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef100bab10 0x7fef101ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 --2- 172.21.15.73:0/1169132042 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fef101abb80 0x7fef100cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 >> 172.21.15.73:0/1169132042 conn(0x7fef100c5b00 msgr2=0x7fef100c0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 shutdown_connections 2024-03-24T10:40:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.516 7fef16966700 1 -- 172.21.15.73:0/1169132042 wait complete. 2024-03-24T10:40:23.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr' 2024-03-24T10:40:23.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.653 7f8227cf4700 1 Processor -- start 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.653 7f8227cf4700 1 -- start start 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f822010cac0 0x7f82201a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201a6b60 0x7f82201a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822010cf10 con 0x7f82200f58a0 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200fa210 con 0x7f822010cac0 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200f9540 con 0x7f82201a6b60 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f822010cac0 0x7f82201a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8224aef700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f82200f58a0 0x7f822010c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60286/0 (socket says 172.21.15.73:60286) 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8224aef700 1 -- 172.21.15.73:0/1923938239 learned_addr learned my addr 172.21.15.73:0/1923938239 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f82252f0700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201a6b60 0x7f82201a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 -- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201a6b60 msgr2=0x7f82201a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201a6b60 0x7f82201a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 -- 172.21.15.73:0/1923938239 >> v1:172.21.15.73:6789/0 conn(0x7f82200f58a0 legacy=0x7f822010c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 -- 172.21.15.73:0/1923938239 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82201aa600 con 0x7f822010cac0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821f7fe700 1 -- 172.21.15.73:0/1923938239 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7708954 0 0) 0x7f8214001110 con 0x7f82200f58a0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821ffff700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822010cac0 0x7f82201a6530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f8220113380 tx=0x7f820c00ba20).ready entity=mon.0 client_cookie=c45d59cb87f2713c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821f7fe700 1 -- 172.21.15.73:0/1923938239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82201aa600 con 0x7f822010cac0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821f7fe700 1 -- 172.21.15.73:0/1923938239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00d5c0 con 0x7f822010cac0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f821f7fe700 1 -- 172.21.15.73:0/1923938239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f820c00d990 con 0x7f822010cac0 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 -- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822010cac0 msgr2=0x7f82201a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.654 7f8227cf4700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822010cac0 0x7f82201a6530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f8220113380 tx=0x7f820c00ba20).stop 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 -- 172.21.15.73:0/1923938239 shutdown_connections 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201a6b60 0x7f82201a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 --2- 172.21.15.73:0/1923938239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822010cac0 0x7f82201a6530 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 -- 172.21.15.73:0/1923938239 >> 172.21.15.73:0/1923938239 conn(0x7f82201139f0 msgr2=0x7f82200f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 -- 172.21.15.73:0/1923938239 shutdown_connections 2024-03-24T10:40:23.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.655 7f8227cf4700 1 -- 172.21.15.73:0/1923938239 wait complete. 2024-03-24T10:40:23.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 Processor -- start 2024-03-24T10:40:23.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 -- start start 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200effc0 con 0x7f82201adfa0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c4800 con 0x7f82201ae3f0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8227cf4700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82200de010 con 0x7f82201a67f0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8224aef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f821ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f82252f0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8224aef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36404/0 (socket says 172.21.15.73:36404) 2024-03-24T10:40:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f821ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57544/0 (socket says 172.21.15.73:57544) 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f82252f0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57826/0 (socket says 172.21.15.73:57826) 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.678 7f8224aef700 1 -- 172.21.15.73:0/463837987 learned_addr learned my addr 172.21.15.73:0/463837987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 -- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 msgr2=0x7f82201ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 -- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 msgr2=0x7f82201b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 -- 172.21.15.73:0/463837987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82201b4f00 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f8224aef700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f82252f0700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821ffff700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f82200d7970 tx=0x7f820c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82201b4f00 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c011760 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f8227cf4700 1 -- 172.21.15.73:0/463837987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82201b51c0 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f820c011b30 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f8227cf4700 1 -- 172.21.15.73:0/463837987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82201bbc80 con 0x7f82201adfa0 2024-03-24T10:40:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.679 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f820c027460 con 0x7f82201adfa0 2024-03-24T10:40:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.680 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f820c02bb50 con 0x7f82201adfa0 2024-03-24T10:40:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.680 7f8227cf4700 1 -- 172.21.15.73:0/463837987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82201a7240 con 0x7f82201adfa0 2024-03-24T10:40:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.683 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f820c00d3b0 con 0x7f82201adfa0 2024-03-24T10:40:23.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:23.822 7f8227cf4700 1 -- 172.21.15.73:0/463837987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]} v 0) v1 -- 0x7f82200f0860 con 0x7f82201adfa0 2024-03-24T10:40:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.215 7f821dffb700 1 -- 172.21.15.73:0/463837987 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]}]=0 v69) v1 ==== 136+0+0 (secure 0 0 0) 0x7f820c011550 con 0x7f82201adfa0 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 -- 172.21.15.73:0/463837987 >> v1:172.21.15.73:6816/43277 conn(0x7f82080145b0 legacy=0x7f8208016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 -- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 msgr2=0x7f82201b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f82200d7970 tx=0x7f820c0068c0).stop 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 -- 172.21.15.73:0/463837987 shutdown_connections 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82201ae3f0 0x7f82201b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f82201a67f0 0x7f82201ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 --2- 172.21.15.73:0/463837987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82201adfa0 0x7f82201b42a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 -- 172.21.15.73:0/463837987 >> 172.21.15.73:0/463837987 conn(0x7f82200c6c70 msgr2=0x7f82200c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.216 7f8227cf4700 1 -- 172.21.15.73:0/463837987 shutdown_connections 2024-03-24T10:40:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.217 7f8227cf4700 1 -- 172.21.15.73:0/463837987 wait complete. 2024-03-24T10:40:24.231 INFO:tasks.cephfs_test_runner:For nautilus it will crash the MDSs when receive unknown OPs, as a workaround ... ok 2024-03-24T10:40:24.231 INFO:tasks.cephfs_test_runner: 2024-03-24T10:40:24.231 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-24T10:40:24.231 INFO:tasks.cephfs_test_runner:Ran 1 test in 38.075s 2024-03-24T10:40:24.231 INFO:tasks.cephfs_test_runner: 2024-03-24T10:40:24.232 INFO:tasks.cephfs_test_runner:OK 2024-03-24T10:40:24.232 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-24T10:40:24.242 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-24T10:40:24.259 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-24T10:40:24.259 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-03-24T10:40:24.260 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:40:24.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275376k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2024-03-24T10:40:24.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:24.311 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-03-24T10:40:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-24T10:40:24.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:24.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:40:24.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:40:24.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-03-24T10:40:24.538 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-24T10:40:24.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-24T10:40:24.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 Processor -- start 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 -- start start 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 0x7f406c0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0fa210 con 0x7f406c10cd40 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0f9540 con 0x7f406c0f58a0 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f40723ef700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0f2470 con 0x7f406c10c8f0 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406a885700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 0x7f406c0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57834/0 (socket says 172.21.15.73:57834) 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b887700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57558/0 (socket says 172.21.15.73:57558) 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 -- 172.21.15.73:0/328796359 learned_addr learned my addr 172.21.15.73:0/328796359 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 -- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 msgr2=0x7f406c0f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 0x7f406c0f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 -- 172.21.15.73:0/328796359 >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 msgr2=0x7f406c0f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 --2- 172.21.15.73:0/328796359 >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b086700 1 -- 172.21.15.73:0/328796359 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0f26a0 con 0x7f406c0f58a0 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406a885700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 0x7f406c0f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.685 7f406b887700 1 --2- 172.21.15.73:0/328796359 >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f406b086700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4060002f70 tx=0x7f4060009a50).ready entity=mon.1 client_cookie=a7a116ffe3585f23 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f406a084700 1 -- 172.21.15.73:0/328796359 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f406c0f26a0 con 0x7f406c0f58a0 2024-03-24T10:40:24.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f406a084700 1 -- 172.21.15.73:0/328796359 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406000f510 con 0x7f406c0f58a0 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f406a084700 1 -- 172.21.15.73:0/328796359 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f406000f6f0 con 0x7f406c0f58a0 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 -- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 msgr2=0x7f406c10c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4060002f70 tx=0x7f4060009a50).stop 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 -- 172.21.15.73:0/328796359 shutdown_connections 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 --2- 172.21.15.73:0/328796359 >> v2:172.21.15.73:3300/0 conn(0x7f406c10cd40 0x7f406c0f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0f58a0 0x7f406c10c2c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 --2- 172.21.15.73:0/328796359 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c10c8f0 0x7f406c0f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 -- 172.21.15.73:0/328796359 >> 172.21.15.73:0/328796359 conn(0x7f406c1139f0 msgr2=0x7f406c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 -- 172.21.15.73:0/328796359 shutdown_connections 2024-03-24T10:40:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.686 7f40723ef700 1 -- 172.21.15.73:0/328796359 wait complete. 2024-03-24T10:40:24.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.709 7f40723ef700 1 Processor -- start 2024-03-24T10:40:24.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.709 7f40723ef700 1 -- start start 2024-03-24T10:40:24.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f406c0d5ef0 0x7f406c1b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0deaa0 con 0x7f406c0d5ef0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0deda0 con 0x7f406c0df6c0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1b2e40 con 0x7f406c0d5aa0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406a885700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57842/0 (socket says 172.21.15.73:57842) 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406a885700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36430/0 (socket says 172.21.15.73:36430) 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 -- 172.21.15.73:0/954919369 learned_addr learned my addr 172.21.15.73:0/954919369 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b887700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f406c0d5ef0 0x7f406c1b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 -- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 msgr2=0x7f406c1b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 -- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f406c0d5ef0 msgr2=0x7f406c1b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f406c0d5ef0 0x7f406c1b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 -- 172.21.15.73:0/954919369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0f0180 con 0x7f406c0df6c0 2024-03-24T10:40:24.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406a885700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f406b086700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f406c1a7590 tx=0x7f40600068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f406c0f0180 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060011610 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f40723ef700 1 -- 172.21.15.73:0/954919369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c1b30e0 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.710 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40600119e0 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.711 7f40723ef700 1 -- 172.21.15.73:0/954919369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c1b9bc0 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.711 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4060011be0 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.711 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f4060001b90 con 0x7f406c0df6c0 2024-03-24T10:40:24.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.712 7f40723ef700 1 -- 172.21.15.73:0/954919369 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c0f0860 con 0x7f406c0df6c0 2024-03-24T10:40:24.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.715 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4060011400 con 0x7f406c0df6c0 2024-03-24T10:40:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.815 7f40723ef700 1 -- 172.21.15.73:0/954919369 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f406c0df0f0 con 0x7f404c0145b0 2024-03-24T10:40:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.817 7f4068881700 1 -- 172.21.15.73:0/954919369 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32208 (unknown 2965378022 0 2221419077) 0x7f405c00bae0 con 0x7f404c0145b0 2024-03-24T10:40:24.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 >> v1:172.21.15.73:6816/43277 conn(0x7f404c0145b0 legacy=0x7f404c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 msgr2=0x7f406c0d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f406c1a7590 tx=0x7f40600068c0).stop 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 shutdown_connections 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f406c0d5ef0 0x7f406c1b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f406c0df6c0 0x7f406c0d5470 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 --2- 172.21.15.73:0/954919369 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f406c0d5aa0 0x7f406c1b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 >> 172.21.15.73:0/954919369 conn(0x7f406c0c90e0 msgr2=0x7f406c0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 shutdown_connections 2024-03-24T10:40:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.818 7f40723ef700 1 -- 172.21.15.73:0/954919369 wait complete. 2024-03-24T10:40:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-03-24 10:40:23.219275","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195272,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292088,"statfs":{"total":386547056640,"available":382251098112,"internally_reserved":4294967296,"allocated":958464,"data_stored":291542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794016","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:40:04.794016","last_peered":"2024-03-24 10:40:04.794016","last_clean":"2024-03-24 10:40:04.794016","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:04.794016","last_undegraded":"2024-03-24 10:40:04.794016","last_fullsized":"2024-03-24 10:40:04.794016","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785470","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:40:04.785470","last_peered":"2024-03-24 10:40:04.785470","last_clean":"2024-03-24 10:40:04.785470","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:04.785470","last_undegraded":"2024-03-24 10:40:04.785470","last_fullsized":"2024-03-24 10:40:04.785470","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.783985","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:04.783985","last_peered":"2024-03-24 10:40:04.783985","last_clean":"2024-03-24 10:40:04.783985","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:04.783985","last_undegraded":"2024-03-24 10:40:04.783985","last_fullsized":"2024-03-24 10:40:04.783985","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791506","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:04.791506","last_peered":"2024-03-24 10:40:04.791506","last_clean":"2024-03-24 10:40:04.791506","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:04.791506","last_undegraded":"2024-03-24 10:40:04.791506","last_fullsized":"2024-03-24 10:40:04.791506","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792326","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:04.792326","last_peered":"2024-03-24 10:40:04.792326","last_clean":"2024-03-24 10:40:04.792326","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:04.792326","last_undegraded":"2024-03-24 10:40:04.792326","last_fullsized":"2024-03-24 10:40:04.792326","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786388","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:40:04.786388","last_peered":"2024-03-24 10:40:04.786388","last_clean":"2024-03-24 10:40:04.786388","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:04.786388","last_undegraded":"2024-03-24 10:40:04.786388","last_fullsized":"2024-03-24 10:40:04.786388","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786255","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:04.786255","last_peered":"2024-03-24 10:40:04.786255","last_clean":"2024-03-24 10:40:04.786255","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:04.786255","last_undegraded":"2024-03-24 10:40:04.786255","last_fullsized":"2024-03-24 10:40:04.786255","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799312","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:04.799312","last_peered":"2024-03-24 10:40:04.799312","last_clean":"2024-03-24 10:40:04.799312","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:04.799312","last_undegraded":"2024-03-24 10:40:04.799312","last_fullsized":"2024-03-24 10:40:04.799312","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705680,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":75697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.24399999999999999}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.22}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.248},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.23200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705681,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.25},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.23699999999999999}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23200000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.223}]}]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":70164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.218},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.224}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27200000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.249}]}]},{"osd":1,"up_from":9,"seq":38654705681,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":70730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.22},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.249}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.25900000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.223},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.23499999999999999}]}]}]}} 2024-03-24T10:40:24.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:24.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 Processor -- start 2024-03-24T10:40:24.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 -- start start 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 0x7fd7c01a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 0x7fd7c01a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c010bce0 con 0x7fd7c00f5990 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00fa510 con 0x7fd7c01a5950 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7c6968700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01a0bd0 con 0x7fd7c010b890 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7b7fff700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 0x7fd7c01a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7bfdec700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 0x7fd7c01a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7bf5eb700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd7c00f5990 0x7fd7c010b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60296/0 (socket says 172.21.15.73:60296) 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.956 7fd7bf5eb700 1 -- 172.21.15.73:0/880527654 learned_addr learned my addr 172.21.15.73:0/880527654 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7bedea700 1 -- 172.21.15.73:0/880527654 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744859923 0 0) 0x7fd7b0001110 con 0x7fd7c00f5990 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7b7fff700 1 -- 172.21.15.73:0/880527654 >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 msgr2=0x7fd7c01a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7b7fff700 1 --2- 172.21.15.73:0/880527654 >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 0x7fd7c01a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7b7fff700 1 -- 172.21.15.73:0/880527654 >> v1:172.21.15.73:6789/0 conn(0x7fd7c00f5990 legacy=0x7fd7c010b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7b7fff700 1 -- 172.21.15.73:0/880527654 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c01a93f0 con 0x7fd7c010b890 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7bfdec700 1 --2- 172.21.15.73:0/880527654 >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 0x7fd7c01a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7b7fff700 1 --2- 172.21.15.73:0/880527654 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 0x7fd7c01a5320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fd7c0103990 tx=0x7fd7a800b9a0).ready entity=mon.2 client_cookie=dd1feab7405afe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7bedea700 1 -- 172.21.15.73:0/880527654 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c01a93f0 con 0x7fd7c010b890 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7bedea700 1 -- 172.21.15.73:0/880527654 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a800d5c0 con 0x7fd7c010b890 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.957 7fd7bedea700 1 -- 172.21.15.73:0/880527654 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7a800d990 con 0x7fd7c010b890 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 -- 172.21.15.73:0/880527654 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 msgr2=0x7fd7c01a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 --2- 172.21.15.73:0/880527654 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 0x7fd7c01a5320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fd7c0103990 tx=0x7fd7a800b9a0).stop 2024-03-24T10:40:24.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 -- 172.21.15.73:0/880527654 shutdown_connections 2024-03-24T10:40:24.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 --2- 172.21.15.73:0/880527654 >> v2:172.21.15.73:3300/0 conn(0x7fd7c01a5950 0x7fd7c01a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 --2- 172.21.15.73:0/880527654 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c010b890 0x7fd7c01a5320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 -- 172.21.15.73:0/880527654 >> 172.21.15.73:0/880527654 conn(0x7fd7c01139f0 msgr2=0x7fd7c00f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:24.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 -- 172.21.15.73:0/880527654 shutdown_connections 2024-03-24T10:40:24.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.958 7fd7c6968700 1 -- 172.21.15.73:0/880527654 wait complete. 2024-03-24T10:40:24.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 Processor -- start 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 -- start start 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 0x7fd7c01b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 0x7fd7c01b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00e6520 con 0x7fd7c01ad620 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00c2fe0 con 0x7fd7c01b4620 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.980 7fd7c6968700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01b50a0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bf5eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bf5eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57578/0 (socket says 172.21.15.73:57578) 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bfdec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 0x7fd7c01b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bf5eb700 1 -- 172.21.15.73:0/1984876463 learned_addr learned my addr 172.21.15.73:0/1984876463 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 0x7fd7c01b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 -- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 msgr2=0x7fd7c01b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 0x7fd7c01b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 -- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 msgr2=0x7fd7c01ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 -- 172.21.15.73:0/1984876463 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00c31f0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bf5eb700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bfdec700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 0x7fd7c01b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7b7fff700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 0x7fd7c01b3ff0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd7c00c5ea0 tx=0x7fd7a80068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7c00c31f0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80117e0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c00c3a90 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7a8011bb0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.981 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01bb8c0 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.982 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd7a8027460 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.982 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fd7a802bb50 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.982 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00f0860 con 0x7fd7c01ae0a0 2024-03-24T10:40:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:24.985 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd7a80115d0 con 0x7fd7c01ae0a0 2024-03-24T10:40:25.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.087 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fd7c01a6c30 con 0x7fd7a40145b0 2024-03-24T10:40:25.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.089 7fd7bd5e7700 1 -- 172.21.15.73:0/1984876463 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32208 (unknown 2965378022 0 2221419077) 0x7fd7b0001580 con 0x7fd7a40145b0 2024-03-24T10:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:25.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 >> v1:172.21.15.73:6816/43277 conn(0x7fd7a40145b0 legacy=0x7fd7a4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 msgr2=0x7fd7c01b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 0x7fd7c01b3ff0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd7c00c5ea0 tx=0x7fd7a80068c0).stop 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 shutdown_connections 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7c01b4620 0x7fd7c01b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7c01ad620 0x7fd7c01ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 --2- 172.21.15.73:0/1984876463 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fd7c01ae0a0 0x7fd7c01b3ff0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 >> 172.21.15.73:0/1984876463 conn(0x7fd7c00c52a0 msgr2=0x7fd7c00f1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 shutdown_connections 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.090 7fd7c6968700 1 -- 172.21.15.73:0/1984876463 wait complete. 2024-03-24T10:40:25.093 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-03-24 10:40:23.219275","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195272,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292088,"statfs":{"total":386547056640,"available":382251098112,"internally_reserved":4294967296,"allocated":958464,"data_stored":291542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.794016","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:40:04.794016","last_peered":"2024-03-24 10:40:04.794016","last_clean":"2024-03-24 10:40:04.794016","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:04.794016","last_undegraded":"2024-03-24 10:40:04.794016","last_fullsized":"2024-03-24 10:40:04.794016","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.785470","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:40:04.785470","last_peered":"2024-03-24 10:40:04.785470","last_clean":"2024-03-24 10:40:04.785470","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:04.785470","last_undegraded":"2024-03-24 10:40:04.785470","last_fullsized":"2024-03-24 10:40:04.785470","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.783985","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:04.783985","last_peered":"2024-03-24 10:40:04.783985","last_clean":"2024-03-24 10:40:04.783985","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:04.783985","last_undegraded":"2024-03-24 10:40:04.783985","last_fullsized":"2024-03-24 10:40:04.783985","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.791506","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:04.791506","last_peered":"2024-03-24 10:40:04.791506","last_clean":"2024-03-24 10:40:04.791506","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:04.791506","last_undegraded":"2024-03-24 10:40:04.791506","last_fullsized":"2024-03-24 10:40:04.791506","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.792326","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:04.792326","last_peered":"2024-03-24 10:40:04.792326","last_clean":"2024-03-24 10:40:04.792326","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:04.792326","last_undegraded":"2024-03-24 10:40:04.792326","last_fullsized":"2024-03-24 10:40:04.792326","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786388","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:40:04.786388","last_peered":"2024-03-24 10:40:04.786388","last_clean":"2024-03-24 10:40:04.786388","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:04.786388","last_undegraded":"2024-03-24 10:40:04.786388","last_fullsized":"2024-03-24 10:40:04.786388","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.786255","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:04.786255","last_peered":"2024-03-24 10:40:04.786255","last_clean":"2024-03-24 10:40:04.786255","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:04.786255","last_undegraded":"2024-03-24 10:40:04.786255","last_fullsized":"2024-03-24 10:40:04.786255","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-03-24 10:40:04.799312","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:04.799312","last_peered":"2024-03-24 10:40:04.799312","last_clean":"2024-03-24 10:40:04.799312","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:04.799312","last_undegraded":"2024-03-24 10:40:04.799312","last_fullsized":"2024-03-24 10:40:04.799312","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705680,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":75697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.24399999999999999}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.22}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.248},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.23200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705681,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.25},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.23699999999999999}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23200000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.223}]}]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":70164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.218},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.224}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27200000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.249}]}]},{"osd":1,"up_from":9,"seq":38654705681,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":70730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.22},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.249}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.25900000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.223},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.23499999999999999}]}]}]}} 2024-03-24T10:40:25.104 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-24T10:40:25.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 Processor -- start 2024-03-24T10:40:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 -- start start 2024-03-24T10:40:25.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 0x7f43901a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43901a8d60 0x7f43901ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43900f3990 con 0x7f43900f3540 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900f9560 con 0x7f43901a8d60 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43982f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900fa3c0 con 0x7f43900f2170 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43950f2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f43900f3540 0x7f43900f1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60312/0 (socket says 172.21.15.73:60312) 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43950f2700 1 -- 172.21.15.73:0/206934695 learned_addr learned my addr 172.21.15.73:0/206934695 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43948f1700 1 --2- 172.21.15.73:0/206934695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 0x7f43901a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.232 7f43958f3700 1 --2- 172.21.15.73:0/206934695 >> v2:172.21.15.73:3300/0 conn(0x7f43901a8d60 0x7f43901ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f4387fff700 1 -- 172.21.15.73:0/206934695 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554990641 0 0) 0x7f43900f3990 con 0x7f43900f3540 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f4387fff700 1 -- 172.21.15.73:0/206934695 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4374003270 con 0x7f43900f3540 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43948f1700 1 -- 172.21.15.73:0/206934695 >> v2:172.21.15.73:3300/0 conn(0x7f43901a8d60 msgr2=0x7f43901ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43948f1700 1 --2- 172.21.15.73:0/206934695 >> v2:172.21.15.73:3300/0 conn(0x7f43901a8d60 0x7f43901ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43948f1700 1 -- 172.21.15.73:0/206934695 >> v1:172.21.15.73:6789/0 conn(0x7f43900f3540 legacy=0x7f43900f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43948f1700 1 -- 172.21.15.73:0/206934695 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900f25c0 con 0x7f43900f2170 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43948f1700 1 --2- 172.21.15.73:0/206934695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 0x7f43901a8730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4380002f70 tx=0x7f438000b970).ready entity=mon.1 client_cookie=6865c512c145222d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f4387fff700 1 -- 172.21.15.73:0/206934695 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43900f25c0 con 0x7f43900f2170 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f4387fff700 1 -- 172.21.15.73:0/206934695 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000d570 con 0x7f43900f2170 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f4387fff700 1 -- 172.21.15.73:0/206934695 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f438000d940 con 0x7f43900f2170 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43982f7700 1 -- 172.21.15.73:0/206934695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 msgr2=0x7f43901a8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.233 7f43982f7700 1 --2- 172.21.15.73:0/206934695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 0x7f43901a8730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4380002f70 tx=0x7f438000b970).stop 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 -- 172.21.15.73:0/206934695 shutdown_connections 2024-03-24T10:40:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 --2- 172.21.15.73:0/206934695 >> v2:172.21.15.73:3300/0 conn(0x7f43901a8d60 0x7f43901ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 --2- 172.21.15.73:0/206934695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43900f2170 0x7f43901a8730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 -- 172.21.15.73:0/206934695 >> 172.21.15.73:0/206934695 conn(0x7f4390113a80 msgr2=0x7f43900f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:25.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 -- 172.21.15.73:0/206934695 shutdown_connections 2024-03-24T10:40:25.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.234 7f43982f7700 1 -- 172.21.15.73:0/206934695 wait complete. 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.256 7f43982f7700 1 Processor -- start 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 -- start start 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 0x7f43901b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 0x7f43901b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900d6b90 con 0x7f43901adac0 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900c4a50 con 0x7f43901ae540 2024-03-24T10:40:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43982f7700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43900d5f40 con 0x7f43901b4a40 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43950f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 0x7f43901b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43950f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57594/0 (socket says 172.21.15.73:57594) 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43950f2700 1 -- 172.21.15.73:0/2910214008 learned_addr learned my addr 172.21.15.73:0/2910214008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43958f3700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 0x7f43901b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 -- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 msgr2=0x7f43901b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 0x7f43901b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 -- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 msgr2=0x7f43901adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 -- 172.21.15.73:0/2910214008 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43901bbb00 con 0x7f43901ae540 2024-03-24T10:40:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43958f3700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 0x7f43901b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43950f2700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.257 7f43948f1700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 0x7f43901b4410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4380002f70 tx=0x7f43800068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43901bbb00 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43800116e0 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43982f7700 1 -- 172.21.15.73:0/2910214008 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43901bbd00 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4380011ab0 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43982f7700 1 -- 172.21.15.73:0/2910214008 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43901bc0e0 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4380011cb0 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.258 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f4380021d60 con 0x7f43901ae540 2024-03-24T10:40:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.259 7f43982f7700 1 -- 172.21.15.73:0/2910214008 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43900d4350 con 0x7f43901ae540 2024-03-24T10:40:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.262 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f43800114d0 con 0x7f43901ae540 2024-03-24T10:40:25.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.364 7f43982f7700 1 -- 172.21.15.73:0/2910214008 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4390087810 con 0x7f43780145b0 2024-03-24T10:40:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.365 7f43867fc700 1 -- 172.21.15.73:0/2910214008 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32330 (unknown 2965378022 0 1808793145) 0x7f438c001580 con 0x7f43780145b0 2024-03-24T10:40:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.366 7f43982f7700 1 -- 172.21.15.73:0/2910214008 >> v1:172.21.15.73:6816/43277 conn(0x7f43780145b0 legacy=0x7f4378016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.366 7f43982f7700 1 -- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 msgr2=0x7f43901b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.366 7f43982f7700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 0x7f43901b4410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4380002f70 tx=0x7f43800068c0).stop 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 -- 172.21.15.73:0/2910214008 shutdown_connections 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f43901b4a40 0x7f43901b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43901adac0 0x7f43901adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 --2- 172.21.15.73:0/2910214008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43901ae540 0x7f43901b4410 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 -- 172.21.15.73:0/2910214008 >> 172.21.15.73:0/2910214008 conn(0x7f43900c91b0 msgr2=0x7f43900c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 -- 172.21.15.73:0/2910214008 shutdown_connections 2024-03-24T10:40:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.367 7f43982f7700 1 -- 172.21.15.73:0/2910214008 wait complete. 2024-03-24T10:40:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:25.379 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-03-24 10:40:25.124927","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195344,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292016,"statfs":{"total":386547056640,"available":382251024384,"internally_reserved":4294967296,"allocated":1015808,"data_stored":319928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.203278","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:40:22.203278","last_peered":"2024-03-24 10:40:22.203278","last_clean":"2024-03-24 10:40:22.203278","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:22.203278","last_undegraded":"2024-03-24 10:40:22.203278","last_fullsized":"2024-03-24 10:40:22.203278","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.214129","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:40:20.214129","last_peered":"2024-03-24 10:40:20.214129","last_clean":"2024-03-24 10:40:20.214129","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:20.214129","last_undegraded":"2024-03-24 10:40:20.214129","last_fullsized":"2024-03-24 10:40:20.214129","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.749444","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:22.749444","last_peered":"2024-03-24 10:40:22.749444","last_clean":"2024-03-24 10:40:22.749444","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:22.749444","last_undegraded":"2024-03-24 10:40:22.749444","last_fullsized":"2024-03-24 10:40:22.749444","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.201302","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:22.201302","last_peered":"2024-03-24 10:40:22.201302","last_clean":"2024-03-24 10:40:22.201302","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:22.201302","last_undegraded":"2024-03-24 10:40:22.201302","last_fullsized":"2024-03-24 10:40:22.201302","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.748643","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:22.748643","last_peered":"2024-03-24 10:40:22.748643","last_clean":"2024-03-24 10:40:22.748643","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:22.748643","last_undegraded":"2024-03-24 10:40:22.748643","last_fullsized":"2024-03-24 10:40:22.748643","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.213883","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:40:20.213883","last_peered":"2024-03-24 10:40:20.213883","last_clean":"2024-03-24 10:40:20.213883","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:20.213883","last_undegraded":"2024-03-24 10:40:20.213883","last_fullsized":"2024-03-24 10:40:20.213883","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.214545","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:20.214545","last_peered":"2024-03-24 10:40:20.214545","last_clean":"2024-03-24 10:40:20.214545","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:20.214545","last_undegraded":"2024-03-24 10:40:20.214545","last_fullsized":"2024-03-24 10:40:20.214545","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.749877","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:22.749877","last_peered":"2024-03-24 10:40:22.749877","last_clean":"2024-03-24 10:40:22.749877","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:22.749877","last_undegraded":"2024-03-24 10:40:22.749877","last_fullsized":"2024-03-24 10:40:22.749877","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.219},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23100000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.377},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29899999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.34000000000000002}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.35199999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.25}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.312},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.27600000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.214},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.23499999999999999}]}]}]}} 2024-03-24T10:40:25.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:40:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.503 7f633c06c700 1 Processor -- start 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.503 7f633c06c700 1 -- start start 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f633410c970 0x7f63340f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340fa290 con 0x7f63340f5920 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340f95c0 con 0x7f633410cdc0 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63340f24f0 con 0x7f633410c970 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6338e67700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6338e67700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57600/0 (socket says 172.21.15.73:57600) 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57880/0 (socket says 172.21.15.73:57880) 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6338e67700 1 -- 172.21.15.73:0/1270590411 learned_addr learned my addr 172.21.15.73:0/1270590411 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:25.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f632bfff700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f633410c970 0x7f63340f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 -- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f633410c970 msgr2=0x7f63340f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f633410c970 0x7f63340f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 -- 172.21.15.73:0/1270590411 >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 msgr2=0x7f633410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 --2- 172.21.15.73:0/1270590411 >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 -- 172.21.15.73:0/1270590411 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340f2720 con 0x7f633410cdc0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6338e67700 1 --2- 172.21.15.73:0/1270590411 >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f6339668700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f63340f4640 tx=0x7f632c00f330).ready entity=mon.1 client_cookie=bca002f3e7c68534 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f632b7fe700 1 -- 172.21.15.73:0/1270590411 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63340f2720 con 0x7f633410cdc0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f632b7fe700 1 -- 172.21.15.73:0/1270590411 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00fb30 con 0x7f633410cdc0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f632b7fe700 1 -- 172.21.15.73:0/1270590411 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f632c013070 con 0x7f633410cdc0 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 -- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 msgr2=0x7f63340f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.504 7f633c06c700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f63340f4640 tx=0x7f632c00f330).stop 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 -- 172.21.15.73:0/1270590411 shutdown_connections 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633410cdc0 0x7f63340f1ec0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 --2- 172.21.15.73:0/1270590411 >> v2:172.21.15.73:3300/0 conn(0x7f63340f5920 0x7f633410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 --2- 172.21.15.73:0/1270590411 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f633410c970 0x7f63340f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 -- 172.21.15.73:0/1270590411 >> 172.21.15.73:0/1270590411 conn(0x7f6334113a70 msgr2=0x7f63340f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 -- 172.21.15.73:0/1270590411 shutdown_connections 2024-03-24T10:40:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.505 7f633c06c700 1 -- 172.21.15.73:0/1270590411 wait complete. 2024-03-24T10:40:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.527 7f633c06c700 1 Processor -- start 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.527 7f633c06c700 1 -- start start 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 0x7f63340d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340f0150 con 0x7f63340d98e0 2024-03-24T10:40:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340c29f0 con 0x7f63340d1ea0 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f633c06c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63341a51c0 con 0x7f63340d1420 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f632bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6338e67700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 0x7f63340d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f632bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57892/0 (socket says 172.21.15.73:57892) 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6338e67700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36478/0 (socket says 172.21.15.73:36478) 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f632bfff700 1 -- 172.21.15.73:0/795350733 learned_addr learned my addr 172.21.15.73:0/795350733 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 -- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 msgr2=0x7f63340d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 -- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 msgr2=0x7f63340d92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 -- 172.21.15.73:0/795350733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63341a3e90 con 0x7f63340d98e0 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6338e67700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f632bfff700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.528 7f6339668700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 0x7f63340d9d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f63340d5b10 tx=0x7f632c006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63341a3e90 con 0x7f63340d98e0 2024-03-24T10:40:25.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c017990 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f632c017d60 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f633c06c700 1 -- 172.21.15.73:0/795350733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63341b7c60 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f633c06c700 1 -- 172.21.15.73:0/795350733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63341b8040 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f632c02a060 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.529 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f632c01bae0 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.530 7f633c06c700 1 -- 172.21.15.73:0/795350733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63340d22f0 con 0x7f63340d98e0 2024-03-24T10:40:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.533 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f632c01f070 con 0x7f63340d98e0 2024-03-24T10:40:25.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.639 7f633c06c700 1 -- 172.21.15.73:0/795350733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63340f08e0 con 0x7f63340d98e0 2024-03-24T10:40:25.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.640 7f6329ffb700 1 -- 172.21.15.73:0/795350733 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+5934 (secure 0 0 0) 0x7f632c00d0d0 con 0x7f63340d98e0 2024-03-24T10:40:25.641 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:25.641 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":28,"fsid":"7ccdf8d1-529f-44dc-adcb-8e62b7bebc17","created":"2024-03-24 10:39:02.180139","modified":"2024-03-24 10:40:23.206199","last_up_change":"2024-03-24 10:39:08.204295","last_in_change":"2024-03-24 10:39:08.204295","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-24 10:39:11.524237","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"37db992e-449a-4d2e-b515-f07fdcf73249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":43871}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":43871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":43871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":43871}]},"public_addr":"172.21.15.73:6808/43871","cluster_addr":"172.21.15.73:6809/43871","heartbeat_back_addr":"172.21.15.73:6811/43871","heartbeat_front_addr":"172.21.15.73:6810/43871","state":["exists","up"]},{"osd":1,"uuid":"e8ecc8f4-64bf-4a60-83ab-9f2b1b9e8cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":43872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":43872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":43872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":43872}]},"public_addr":"172.21.15.73:6812/43872","cluster_addr":"172.21.15.73:6813/43872","heartbeat_back_addr":"172.21.15.73:6815/43872","heartbeat_front_addr":"172.21.15.73:6814/43872","state":["exists","up"]},{"osd":2,"uuid":"6f4717bb-78f4-490f-bd87-5d635f4bf7bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":43870}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":43870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":43870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":43870}]},"public_addr":"172.21.15.73:6804/43870","cluster_addr":"172.21.15.73:6805/43870","heartbeat_back_addr":"172.21.15.73:6807/43870","heartbeat_front_addr":"172.21.15.73:6806/43870","state":["exists","up"]},{"osd":3,"uuid":"326791eb-c8da-481b-9c06-3cc467120ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":43869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":43869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":43869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":43869}]},"public_addr":"172.21.15.73:6800/43869","cluster_addr":"172.21.15.73:6801/43869","heartbeat_back_addr":"172.21.15.73:6803/43869","heartbeat_front_addr":"172.21.15.73:6802/43869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.73:6817/3503607711":"2024-03-25 10:40:19.965355"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-24T10:40:25.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 >> v1:172.21.15.73:6816/43277 conn(0x7f63140145b0 legacy=0x7f6314016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 msgr2=0x7f63340d9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:25.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 0x7f63340d9d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f63340d5b10 tx=0x7f632c006c40).stop 2024-03-24T10:40:25.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 shutdown_connections 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63340d98e0 0x7f63340d9d30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f63340d1420 0x7f63340d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 --2- 172.21.15.73:0/795350733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63340d1ea0 0x7f63340d92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 >> 172.21.15.73:0/795350733 conn(0x7f63340e0a00 msgr2=0x7f63340debf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 shutdown_connections 2024-03-24T10:40:25.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:25.641 7f633c06c700 1 -- 172.21.15.73:0/795350733 wait complete. 2024-03-24T10:40:26.654 INFO:tasks.ceph:Scrubbing osd.0 2024-03-24T10:40:26.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.796 7f78e2e7a700 1 Processor -- start 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.796 7f78e2e7a700 1 -- start start 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 0x7f78dc1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78dc0fa500 con 0x7f78dc10b6b0 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc1a0810 con 0x7f78dc10bb00 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78e2e7a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc1a0a40 con 0x7f78dc0f5980 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78d2ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78dbfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 0x7f78dc1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78d2ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57622/0 (socket says 172.21.15.73:57622) 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36488/0 (socket says 172.21.15.73:36488) 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78dbfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 0x7f78dc1a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57904/0 (socket says 172.21.15.73:57904) 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78d2ffd700 1 -- 172.21.15.73:0/1785196312 learned_addr learned my addr 172.21.15.73:0/1785196312 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 -- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 msgr2=0x7f78dc1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 --2- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 0x7f78dc1a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 -- 172.21.15.73:0/1785196312 >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 msgr2=0x7f78dc19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 --2- 172.21.15.73:0/1785196312 >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 -- 172.21.15.73:0/1785196312 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc1a7320 con 0x7f78dc0f5980 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78d2ffd700 1 --2- 172.21.15.73:0/1785196312 >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.797 7f78db7fe700 1 --2- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f78dc0f4730 tx=0x7f78cc00b9a0).ready entity=mon.2 client_cookie=da7fb90a849f4d26 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78daffd700 1 -- 172.21.15.73:0/1785196312 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78dc1a7320 con 0x7f78dc0f5980 2024-03-24T10:40:26.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78daffd700 1 -- 172.21.15.73:0/1785196312 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00d570 con 0x7f78dc0f5980 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78daffd700 1 -- 172.21.15.73:0/1785196312 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78cc00d940 con 0x7f78dc0f5980 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 -- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 msgr2=0x7f78dc10b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 --2- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f78dc0f4730 tx=0x7f78cc00b9a0).stop 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 -- 172.21.15.73:0/1785196312 shutdown_connections 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 --2- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc10bb00 0x7f78dc1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 --2- 172.21.15.73:0/1785196312 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc0f5980 0x7f78dc10b080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 --2- 172.21.15.73:0/1785196312 >> v2:172.21.15.73:3300/0 conn(0x7f78dc10b6b0 0x7f78dc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 -- 172.21.15.73:0/1785196312 >> 172.21.15.73:0/1785196312 conn(0x7f78dc1139e0 msgr2=0x7f78dc0f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 -- 172.21.15.73:0/1785196312 shutdown_connections 2024-03-24T10:40:26.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.798 7f78e2e7a700 1 -- 172.21.15.73:0/1785196312 wait complete. 2024-03-24T10:40:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.821 7f78e2e7a700 1 Processor -- start 2024-03-24T10:40:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.821 7f78e2e7a700 1 -- start start 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 0x7f78dc1ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 0x7f78dc1b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc1b4f60 0x7f78dc1bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0dd850 con 0x7f78dc1b44e0 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0dcc00 con 0x7f78dc1b4f60 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78e2e7a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0dc520 con 0x7f78dc1adf50 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78db7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 0x7f78dc1ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 0x7f78dc1b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78dbfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc1b4f60 0x7f78dc1bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 0x7f78dc1b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57630/0 (socket says 172.21.15.73:57630) 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78db7fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 0x7f78dc1ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36504/0 (socket says 172.21.15.73:36504) 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 -- 172.21.15.73:0/1121401597 learned_addr learned my addr 172.21.15.73:0/1121401597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 -- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 msgr2=0x7f78dc1ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 0x7f78dc1ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 -- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc1b4f60 msgr2=0x7f78dc1bb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc1b4f60 0x7f78dc1bb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 -- 172.21.15.73:0/1121401597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc1b53b0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78db7fe700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f78dc1adf50 0x7f78dc1ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78dbfff700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78dc1b4f60 0x7f78dc1bb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d2ffd700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 0x7f78dc1b4930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f78c40067f0 tx=0x7f78c400ee40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78dc1b53b0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c400dad0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.822 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78c4010440 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.823 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc0dd3e0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.823 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc1bc1d0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.823 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f78c4020060 con 0x7f78dc1b44e0 2024-03-24T10:40:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.823 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f78c40018c0 con 0x7f78dc1b44e0 2024-03-24T10:40:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.823 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 --> v1:172.21.15.73:6808/43871 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78dc087810 con 0x7f78dc0a6bf0 2024-03-24T10:40:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.824 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== osd.0 v1:172.21.15.73:6808/43871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f78d4009ce0 con 0x7f78dc0a6bf0 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 --> v1:172.21.15.73:6808/43871 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f78dc0f0850 con 0x7f78dc0a6bf0 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78d97fa700 1 -- 172.21.15.73:0/1121401597 <== osd.0 v1:172.21.15.73:6808/43871 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7f78dc0f0850 con 0x7f78dc0a6bf0 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 >> v1:172.21.15.73:6808/43871 conn(0x7f78dc0a6bf0 legacy=0x7f78dc0a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 >> v1:172.21.15.73:6816/43277 conn(0x7f78c00145b0 legacy=0x7f78c0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 msgr2=0x7f78dc1b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78e2e7a700 1 --2- 172.21.15.73:0/1121401597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78dc1b44e0 0x7f78dc1b4930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f78c40067f0 tx=0x7f78c400ee40).stop 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.830 7f78dbfff700 1 -- 172.21.15.73:0/1121401597 reap_dead start 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.831 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 shutdown_connections 2024-03-24T10:40:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.831 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 >> 172.21.15.73:0/1121401597 conn(0x7f78dc0e0860 msgr2=0x7f78dc0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.831 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 shutdown_connections 2024-03-24T10:40:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.831 7f78e2e7a700 1 -- 172.21.15.73:0/1121401597 wait complete. 2024-03-24T10:40:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-03-24T10:40:26.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-24T10:40:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 Processor -- start 2024-03-24T10:40:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 -- start start 2024-03-24T10:40:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13d00f5a00 0x7f13d010b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 0x7f13d01a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d01a0a60 con 0x7f13d010b730 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00fa580 con 0x7f13d00f5a00 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.968 7f13d7ded700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01a0c80 con 0x7f13d010bb80 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13d00f5a00 0x7f13d010b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d53e9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 0x7f13d01a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f13d010b730 0x7f13d019fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60328/0 (socket says 172.21.15.73:60328) 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cffff700 1 -- 172.21.15.73:0/1309231917 learned_addr learned my addr 172.21.15.73:0/1309231917 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 -- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 msgr2=0x7f13d01a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 0x7f13d01a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 -- 172.21.15.73:0/1309231917 >> v1:172.21.15.73:6789/0 conn(0x7f13d010b730 legacy=0x7f13d019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cf7fe700 1 -- 172.21.15.73:0/1309231917 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416954155 0 0) 0x7f13bc001110 con 0x7f13d010b730 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 -- 172.21.15.73:0/1309231917 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d01a93c0 con 0x7f13d00f5a00 2024-03-24T10:40:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d53e9700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 0x7f13d01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d4be8700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00f5a00 0x7f13d010b100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f13d0103a00 tx=0x7f13c400ba20).ready entity=mon.0 client_cookie=9b7f6515a38fe568 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cf7fe700 1 -- 172.21.15.73:0/1309231917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13d01a93c0 con 0x7f13d00f5a00 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cf7fe700 1 -- 172.21.15.73:0/1309231917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400d5c0 con 0x7f13d00f5a00 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13cf7fe700 1 -- 172.21.15.73:0/1309231917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13c400d990 con 0x7f13d00f5a00 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d7ded700 1 -- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00f5a00 msgr2=0x7f13d010b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.969 7f13d7ded700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00f5a00 0x7f13d010b100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f13d0103a00 tx=0x7f13c400ba20).stop 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 -- 172.21.15.73:0/1309231917 shutdown_connections 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d010bb80 0x7f13d01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 --2- 172.21.15.73:0/1309231917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00f5a00 0x7f13d010b100 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 -- 172.21.15.73:0/1309231917 >> 172.21.15.73:0/1309231917 conn(0x7f13d0113a60 msgr2=0x7f13d00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 -- 172.21.15.73:0/1309231917 shutdown_connections 2024-03-24T10:40:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.970 7f13d7ded700 1 -- 172.21.15.73:0/1309231917 wait complete. 2024-03-24T10:40:26.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.993 7f13d7ded700 1 Processor -- start 2024-03-24T10:40:26.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.993 7f13d7ded700 1 -- start start 2024-03-24T10:40:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 0x7f13d01b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 0x7f13d01b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0088da0 con 0x7f13d00dc9a0 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00cf970 con 0x7f13d00d7930 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01a6cf0 con 0x7f13d00d7d80 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13cffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 0x7f13d01b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d53e9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 0x7f13d01b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57658/0 (socket says 172.21.15.73:57658) 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 -- 172.21.15.73:0/2065010307 learned_addr learned my addr 172.21.15.73:0/2065010307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 -- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 msgr2=0x7f13d01b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 0x7f13d01b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 -- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 msgr2=0x7f13d01b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 0x7f13d01b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 -- 172.21.15.73:0/2065010307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00dc2e0 con 0x7f13d00dc9a0 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d53e9700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 0x7f13d01b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13cffff700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 0x7f13d01b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d4be8700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f13d00cfc30 tx=0x7f13c40068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13d00dc2e0 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c40117a0 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13c4011b70 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d01b2b90 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.994 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d00c3130 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.995 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f13c4027460 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.995 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f13c4021b70 con 0x7f13d00dc9a0 2024-03-24T10:40:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.995 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d00f08d0 con 0x7f13d00dc9a0 2024-03-24T10:40:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:26.999 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f13c400d3b0 con 0x7f13d00dc9a0 2024-03-24T10:40:27.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.104 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mgr", ""]}) v1 -- 0x7f13d0087740 con 0x7f13b80145b0 2024-03-24T10:40:27.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.104 7f13cdffb700 1 -- 172.21.15.73:0/2065010307 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f13bc001910 con 0x7f13b80145b0 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 >> v1:172.21.15.73:6816/43277 conn(0x7f13b80145b0 legacy=0x7f13b8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 msgr2=0x7f13d00d7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f13d00cfc30 tx=0x7f13c40068c0).stop 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 shutdown_connections 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f13d00d7d80 0x7f13d01b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00dc9a0 0x7f13d00d7300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 --2- 172.21.15.73:0/2065010307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13d00d7930 0x7f13d01b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.105 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 >> 172.21.15.73:0/2065010307 conn(0x7f13d00c53f0 msgr2=0x7f13d00c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.106 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 shutdown_connections 2024-03-24T10:40:27.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.106 7f13d7ded700 1 -- 172.21.15.73:0/2065010307 wait complete. 2024-03-24T10:40:27.108 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-03-24T10:40:27.118 INFO:tasks.ceph:Scrubbing osd.1 2024-03-24T10:40:27.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 Processor -- start 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 -- start start 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 0x7fac240f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 0x7fac2410e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240f9220 con 0x7fac240f2300 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2410f0d0 con 0x7fac240f5910 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2b34e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac241ac670 con 0x7fac240f1eb0 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac237fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 0x7fac2410e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2894a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fac240f2300 0x7fac2410e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60342/0 (socket says 172.21.15.73:60342) 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac23fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 0x7fac240f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac2894a700 1 -- 172.21.15.73:0/977088349 learned_addr learned my addr 172.21.15.73:0/977088349 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac23fff700 1 -- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 msgr2=0x7fac2410e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac22ffd700 1 -- 172.21.15.73:0/977088349 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855415673 0 0) 0x7fac1c001490 con 0x7fac240f2300 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac23fff700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 0x7fac2410e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac23fff700 1 -- 172.21.15.73:0/977088349 >> v1:172.21.15.73:6789/0 conn(0x7fac240f2300 legacy=0x7fac2410e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac23fff700 1 -- 172.21.15.73:0/977088349 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac241ac820 con 0x7fac240f5910 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.247 7fac237fe700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 0x7fac2410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac23fff700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 0x7fac240f1880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fac18002f70 tx=0x7fac1800ba20).ready entity=mon.1 client_cookie=742d8b00e34d70b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac22ffd700 1 -- 172.21.15.73:0/977088349 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac241ac820 con 0x7fac240f5910 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac22ffd700 1 -- 172.21.15.73:0/977088349 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800d570 con 0x7fac240f5910 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac22ffd700 1 -- 172.21.15.73:0/977088349 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac1800d990 con 0x7fac240f5910 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 -- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 msgr2=0x7fac240f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 0x7fac240f1880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fac18002f70 tx=0x7fac1800ba20).stop 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 -- 172.21.15.73:0/977088349 shutdown_connections 2024-03-24T10:40:27.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240f5910 0x7fac240f1880 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 --2- 172.21.15.73:0/977088349 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac240f1eb0 0x7fac2410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 -- 172.21.15.73:0/977088349 >> 172.21.15.73:0/977088349 conn(0x7fac24113a60 msgr2=0x7fac240f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 -- 172.21.15.73:0/977088349 shutdown_connections 2024-03-24T10:40:27.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.248 7fac2b34e700 1 -- 172.21.15.73:0/977088349 wait complete. 2024-03-24T10:40:27.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.271 7fac2b34e700 1 Processor -- start 2024-03-24T10:40:27.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.271 7fac2b34e700 1 -- start start 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.271 7fac2b34e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 0x7fac241b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac241b65b0 0x7fac241b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac241b9040 0x7fac241bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240effd0 con 0x7fac241b9040 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240c2de0 con 0x7fac240d7fe0 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac241b58a0 con 0x7fac241b65b0 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 0x7fac241b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac237fe700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac241b65b0 0x7fac241b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 0x7fac241b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57934/0 (socket says 172.21.15.73:57934) 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 -- 172.21.15.73:0/2679946700 learned_addr learned my addr 172.21.15.73:0/2679946700 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:27.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2894a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac241b9040 0x7fac241bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 -- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac241b65b0 msgr2=0x7fac241b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 --2- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac241b65b0 0x7fac241b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 -- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac241b9040 msgr2=0x7fac241bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 --2- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac241b9040 0x7fac241bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 -- 172.21.15.73:0/2679946700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240d8430 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac237fe700 1 --2- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fac241b65b0 0x7fac241b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac23fff700 1 --2- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 0x7fac241b5f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fac240cb7a0 tx=0x7fac180068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac240d8430 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180119d0 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac240c30a0 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac18017040 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.272 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac241bbcb0 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.273 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fac180273b0 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.273 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fac18018070 con 0x7fac240d7fe0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.273 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 --> v1:172.21.15.73:6812/43872 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac24087810 con 0x7fac240c1cb0 2024-03-24T10:40:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.274 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== osd.1 v1:172.21.15.73:6812/43872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fac1c0017d0 con 0x7fac240c1cb0 2024-03-24T10:40:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 --> v1:172.21.15.73:6812/43872 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fac240f08d0 con 0x7fac240c1cb0 2024-03-24T10:40:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac217fa700 1 -- 172.21.15.73:0/2679946700 <== osd.1 v1:172.21.15.73:6812/43872 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7fac240f08d0 con 0x7fac240c1cb0 2024-03-24T10:40:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 >> v1:172.21.15.73:6812/43872 conn(0x7fac240c1cb0 legacy=0x7fac240a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 >> v1:172.21.15.73:6816/43277 conn(0x7fac04014540 legacy=0x7fac04016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 msgr2=0x7fac241b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 --2- 172.21.15.73:0/2679946700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac240d7fe0 0x7fac241b5f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fac240cb7a0 tx=0x7fac180068c0).stop 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2894a700 1 -- 172.21.15.73:0/2679946700 reap_dead start 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 shutdown_connections 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 >> 172.21.15.73:0/2679946700 conn(0x7fac240dc8b0 msgr2=0x7fac240c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 shutdown_connections 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.280 7fac2b34e700 1 -- 172.21.15.73:0/2679946700 wait complete. 2024-03-24T10:40:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-03-24T10:40:27.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 Processor -- start 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 -- start start 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 0x7f46bc10e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 0x7f46bc0f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0f1e20 con 0x7f46bc10eed0 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0fb660 con 0x7f46bc10ea80 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46c0f32700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc106970 con 0x7f46bc106520 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46b9b64700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 0x7f46bc10e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46ba365700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46bc10eed0 0x7f46bc0f1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60352/0 (socket says 172.21.15.73:60352) 2024-03-24T10:40:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46ba365700 1 -- 172.21.15.73:0/3667880070 learned_addr learned my addr 172.21.15.73:0/3667880070 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.420 7f46b9363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 0x7f46bc0f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9363700 1 -- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 msgr2=0x7f46bc10e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9363700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 0x7f46bc10e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b8b62700 1 -- 172.21.15.73:0/3667880070 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875889951 0 0) 0x7f46b4001490 con 0x7f46bc10eed0 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9363700 1 -- 172.21.15.73:0/3667880070 >> v1:172.21.15.73:6789/0 conn(0x7f46bc10eed0 legacy=0x7f46bc0f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9363700 1 -- 172.21.15.73:0/3667880070 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc1ac7b0 con 0x7f46bc10ea80 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9b64700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 0x7f46bc10e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b9363700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 0x7f46bc0f0ff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f46bc0fb810 tx=0x7f46ac00ba50).ready entity=mon.1 client_cookie=8d5da642492831a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b8b62700 1 -- 172.21.15.73:0/3667880070 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46bc1ac7b0 con 0x7f46bc10ea80 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b8b62700 1 -- 172.21.15.73:0/3667880070 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00d570 con 0x7f46bc10ea80 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46b8b62700 1 -- 172.21.15.73:0/3667880070 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46ac00d940 con 0x7f46bc10ea80 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 -- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 msgr2=0x7f46bc0f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 0x7f46bc0f0ff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f46bc0fb810 tx=0x7f46ac00ba50).stop 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 -- 172.21.15.73:0/3667880070 shutdown_connections 2024-03-24T10:40:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc106520 0x7f46bc10e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 --2- 172.21.15.73:0/3667880070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc10ea80 0x7f46bc0f0ff0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.421 7f46c0f32700 1 -- 172.21.15.73:0/3667880070 >> 172.21.15.73:0/3667880070 conn(0x7f46bc114930 msgr2=0x7f46bc114d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.422 7f46c0f32700 1 -- 172.21.15.73:0/3667880070 shutdown_connections 2024-03-24T10:40:27.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.422 7f46c0f32700 1 -- 172.21.15.73:0/3667880070 wait complete. 2024-03-24T10:40:27.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.444 7f46c0f32700 1 Processor -- start 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.444 7f46c0f32700 1 -- start start 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 0x7f46bc1b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0f0140 con 0x7f46bc1b4a20 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0cdb60 con 0x7f46bc0d6c80 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc1b54a0 con 0x7f46bc0d6200 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46ba365700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36558/0 (socket says 172.21.15.73:36558) 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46ba365700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57688/0 (socket says 172.21.15.73:57688) 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 -- 172.21.15.73:0/2239116222 learned_addr learned my addr 172.21.15.73:0/2239116222 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9363700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 0x7f46bc1b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 -- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 msgr2=0x7f46bc1b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 0x7f46bc1b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 -- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 msgr2=0x7f46bc1b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 -- 172.21.15.73:0/2239116222 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0ce240 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46ba365700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9363700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 0x7f46bc1b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46b9b64700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f46bc0d7600 tx=0x7f46b000bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46bc0ce240 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000ee60 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc0ce8a0 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46b000f040 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.445 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc1bbd50 con 0x7f46bc0d6200 2024-03-24T10:40:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.446 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f46b0011070 con 0x7f46bc0d6200 2024-03-24T10:40:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.446 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f46b0010040 con 0x7f46bc0d6200 2024-03-24T10:40:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.447 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc0f08d0 con 0x7f46bc0d6200 2024-03-24T10:40:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.450 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f46b000c620 con 0x7f46bc0d6200 2024-03-24T10:40:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.553 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mgr", ""]}) v1 -- 0x7f46bc087740 con 0x7f4698014600 2024-03-24T10:40:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.553 7f46aaffd700 1 -- 172.21.15.73:0/2239116222 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f46ac006b30 con 0x7f4698014600 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 >> v1:172.21.15.73:6816/43277 conn(0x7f4698014600 legacy=0x7f4698016b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 msgr2=0x7f46bc0d6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f46bc0d7600 tx=0x7f46b000bf70).stop 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 shutdown_connections 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46bc1b4a20 0x7f46bc1b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f46bc0d6200 0x7f46bc0d6650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 --2- 172.21.15.73:0/2239116222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46bc0d6c80 0x7f46bc1b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 >> 172.21.15.73:0/2239116222 conn(0x7f46bc0c8e60 msgr2=0x7f46bc0c3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.554 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 shutdown_connections 2024-03-24T10:40:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.555 7f46c0f32700 1 -- 172.21.15.73:0/2239116222 wait complete. 2024-03-24T10:40:27.557 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-03-24T10:40:27.566 INFO:tasks.ceph:Scrubbing osd.2 2024-03-24T10:40:27.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 Processor -- start 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 -- start start 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4500f5910 0x7ff4500f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500f9220 con 0x7ff4500f2300 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45010f0d0 con 0x7ff4500f5910 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff4550dc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4501ac670 con 0x7ff4500f1eb0 2024-03-24T10:40:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44ddfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4500f5910 0x7ff4500f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44e5fd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff4500f2300 0x7ff45010e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60362/0 (socket says 172.21.15.73:60362) 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44d5fb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57964/0 (socket says 172.21.15.73:57964) 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44ddfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4500f5910 0x7ff4500f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57692/0 (socket says 172.21.15.73:57692) 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.696 7ff44e5fd700 1 -- 172.21.15.73:0/2534146495 learned_addr learned my addr 172.21.15.73:0/2534146495 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44ddfc700 1 -- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 msgr2=0x7ff45010e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44ddfc700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44ddfc700 1 -- 172.21.15.73:0/2534146495 >> v1:172.21.15.73:6789/0 conn(0x7ff4500f2300 legacy=0x7ff45010e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44cdfa700 1 -- 172.21.15.73:0/2534146495 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127129272 0 0) 0x7ff448001490 con 0x7ff4500f2300 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44ddfc700 1 -- 172.21.15.73:0/2534146495 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4501ac820 con 0x7ff4500f5910 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44d5fb700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44ddfc700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500f5910 0x7ff4500f1880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff444002f70 tx=0x7ff44400b9f0).ready entity=mon.0 client_cookie=9a1536936511aabb server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44cdfa700 1 -- 172.21.15.73:0/2534146495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4501ac820 con 0x7ff4500f5910 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44cdfa700 1 -- 172.21.15.73:0/2534146495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44400d5c0 con 0x7ff4500f5910 2024-03-24T10:40:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.697 7ff44cdfa700 1 -- 172.21.15.73:0/2534146495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff44400d9e0 con 0x7ff4500f5910 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 -- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500f5910 msgr2=0x7ff4500f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500f5910 0x7ff4500f1880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff444002f70 tx=0x7ff44400b9f0).stop 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 -- 172.21.15.73:0/2534146495 shutdown_connections 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500f5910 0x7ff4500f1880 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 --2- 172.21.15.73:0/2534146495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4500f1eb0 0x7ff45010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 -- 172.21.15.73:0/2534146495 >> 172.21.15.73:0/2534146495 conn(0x7ff450113a60 msgr2=0x7ff4500f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 -- 172.21.15.73:0/2534146495 shutdown_connections 2024-03-24T10:40:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.698 7ff4550dc700 1 -- 172.21.15.73:0/2534146495 wait complete. 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.720 7ff4550dc700 1 Processor -- start 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.720 7ff4550dc700 1 -- start start 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 0x7ff4500d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 0x7ff4501b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4501b4ed0 0x7ff4501bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500bc7a0 con 0x7ff4500d72d0 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500d7f40 con 0x7ff4501b4ed0 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500cf6b0 con 0x7ff4500d6850 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44d5fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 0x7ff4501b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 0x7ff4500d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44e5fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4501b4ed0 0x7ff4501bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44d5fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 0x7ff4501b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57706/0 (socket says 172.21.15.73:57706) 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 0x7ff4500d6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36574/0 (socket says 172.21.15.73:36574) 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44d5fb700 1 -- 172.21.15.73:0/3863423117 learned_addr learned my addr 172.21.15.73:0/3863423117 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 -- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4501b4ed0 msgr2=0x7ff4501bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4501b4ed0 0x7ff4501bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 -- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 msgr2=0x7ff4501b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 0x7ff4501b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 -- 172.21.15.73:0/3863423117 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500dbae0 con 0x7ff4500d6850 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44d5fb700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4500d72d0 0x7ff4501b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44e5fd700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4501b4ed0 0x7ff4501bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff44ddfc700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 0x7ff4500d6ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff4500d6340 tx=0x7ff4440068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4500dbae0 con 0x7ff4500d6850 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44400d5c0 con 0x7ff4500d6850 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4501b5320 con 0x7ff4500d6850 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.721 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff444017040 con 0x7ff4500d6850 2024-03-24T10:40:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.722 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501bc3b0 con 0x7ff4500d6850 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.722 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff444006a90 con 0x7ff4500d6850 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.723 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff450087810 con 0x7ff4500d6850 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.723 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7ff444018070 con 0x7ff4500d6850 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.723 7ff43effd700 1 -- 172.21.15.73:0/3863423117 --> v1:172.21.15.73:6804/43870 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42c01e560 con 0x7ff42c01a730 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.723 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff444019700 con 0x7ff4500d6850 2024-03-24T10:40:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.723 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== osd.2 v1:172.21.15.73:6804/43870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7ff42c01e560 con 0x7ff42c01a730 2024-03-24T10:40:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.729 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 --> v1:172.21.15.73:6804/43870 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7ff4500f08d0 con 0x7ff42c01a730 2024-03-24T10:40:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.729 7ff43effd700 1 -- 172.21.15.73:0/3863423117 <== osd.2 v1:172.21.15.73:6804/43870 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7ff4500f08d0 con 0x7ff42c01a730 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.729 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 >> v1:172.21.15.73:6804/43870 conn(0x7ff42c01a730 legacy=0x7ff42c01cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.729 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 >> v1:172.21.15.73:6816/43277 conn(0x7ff42c0145b0 legacy=0x7ff42c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.729 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 msgr2=0x7ff4500d6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff4550dc700 1 --2- 172.21.15.73:0/3863423117 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff4500d6850 0x7ff4500d6ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff4500d6340 tx=0x7ff4440068c0).stop 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff44e5fd700 1 -- 172.21.15.73:0/3863423117 reap_dead start 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 shutdown_connections 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 >> 172.21.15.73:0/3863423117 conn(0x7ff4500bd7d0 msgr2=0x7ff4500bf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 shutdown_connections 2024-03-24T10:40:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.730 7ff4550dc700 1 -- 172.21.15.73:0/3863423117 wait complete. 2024-03-24T10:40:27.732 INFO:teuthology.orchestra.run.smithi073.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-03-24T10:40:27.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 Processor -- start 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 -- start start 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc0f5980 0x7f7fbc10b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fbc10b6b0 0x7f7fbc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc1a09e0 con 0x7f7fbc10bb00 2024-03-24T10:40:27.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0fa500 con 0x7f7fbc10b6b0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.866 7f7fc279d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc1a0c00 con 0x7f7fbc0f5980 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fbc10b6b0 0x7f7fbc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbbbb1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7fbc10bb00 0x7f7fbc1a01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60378/0 (socket says 172.21.15.73:60378) 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbbbb1700 1 -- 172.21.15.73:0/1366422372 learned_addr learned my addr 172.21.15.73:0/1366422372 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbb3b0700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc0f5980 0x7f7fbc10b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 -- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc0f5980 msgr2=0x7f7fbc10b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc0f5980 0x7f7fbc10b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 -- 172.21.15.73:0/1366422372 >> v1:172.21.15.73:6789/0 conn(0x7f7fbc10bb00 legacy=0x7f7fbc1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fba3ae700 1 -- 172.21.15.73:0/1366422372 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385994615 0 0) 0x7f7fb4001490 con 0x7f7fbc10bb00 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 -- 172.21.15.73:0/1366422372 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc1a9340 con 0x7f7fbc10b6b0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fbabaf700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc10b6b0 0x7f7fbc19fbb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f7fac002f70 tx=0x7f7fac00b9f0).ready entity=mon.0 client_cookie=22b59f6b7914be7a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fba3ae700 1 -- 172.21.15.73:0/1366422372 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fbc1a9340 con 0x7f7fbc10b6b0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fba3ae700 1 -- 172.21.15.73:0/1366422372 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00d5c0 con 0x7f7fbc10b6b0 2024-03-24T10:40:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fba3ae700 1 -- 172.21.15.73:0/1366422372 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fac00d990 con 0x7f7fbc10b6b0 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fc279d700 1 -- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc10b6b0 msgr2=0x7f7fbc19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.867 7f7fc279d700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc10b6b0 0x7f7fbc19fbb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f7fac002f70 tx=0x7f7fac00b9f0).stop 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 -- 172.21.15.73:0/1366422372 shutdown_connections 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc0f5980 0x7f7fbc10b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 --2- 172.21.15.73:0/1366422372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc10b6b0 0x7f7fbc19fbb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 -- 172.21.15.73:0/1366422372 >> 172.21.15.73:0/1366422372 conn(0x7f7fbc1139e0 msgr2=0x7f7fbc0f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 -- 172.21.15.73:0/1366422372 shutdown_connections 2024-03-24T10:40:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.868 7f7fc279d700 1 -- 172.21.15.73:0/1366422372 wait complete. 2024-03-24T10:40:27.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.890 7f7fc279d700 1 Processor -- start 2024-03-24T10:40:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 -- start start 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 0x7f7fbc1ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0c50c0 con 0x7f7fbc1ade70 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0c4470 con 0x7f7fbc1ae2c0 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fc279d700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc1b4e20 con 0x7f7fbc1a5550 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbbbb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbb3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 0x7f7fbc1ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbbbb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57982/0 (socket says 172.21.15.73:57982) 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57716/0 (socket says 172.21.15.73:57716) 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbbbb1700 1 -- 172.21.15.73:0/248956960 learned_addr learned my addr 172.21.15.73:0/248956960 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbb3b0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 0x7f7fbc1ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36580/0 (socket says 172.21.15.73:36580) 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 -- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 msgr2=0x7f7fbc1ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 0x7f7fbc1ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 -- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 msgr2=0x7f7fbc1b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbabaf700 1 -- 172.21.15.73:0/248956960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc1b5000 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.891 7f7fbbbb1700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fbabaf700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7fac002f70 tx=0x7f7fac0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fbc1b5000 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac011a00 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7fac017040 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fc279d700 1 -- 172.21.15.73:0/248956960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc1bb930 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fc279d700 1 -- 172.21.15.73:0/248956960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc1bbd10 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7fac026360 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.892 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f7fac018070 con 0x7f7fbc1ade70 2024-03-24T10:40:27.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.893 7f7fc279d700 1 -- 172.21.15.73:0/248956960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc0f0850 con 0x7f7fbc1ade70 2024-03-24T10:40:27.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:27.896 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7fac0117f0 con 0x7f7fbc1ade70 2024-03-24T10:40:28.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.000 7f7fc279d700 1 -- 172.21.15.73:0/248956960 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mgr", ""]}) v1 -- 0x7f7fbc087740 con 0x7f7f9c0145b0 2024-03-24T10:40:28.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.000 7f7fb8bab700 1 -- 172.21.15.73:0/248956960 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f7fb000b730 con 0x7f7f9c0145b0 2024-03-24T10:40:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 >> v1:172.21.15.73:6816/43277 conn(0x7f7f9c0145b0 legacy=0x7f7f9c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 msgr2=0x7f7fbc1b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7fac002f70 tx=0x7f7fac0068c0).stop 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 shutdown_connections 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fbc1ae2c0 0x7f7fbc1b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f7fbc1a5550 0x7f7fbc1ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 --2- 172.21.15.73:0/248956960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fbc1ade70 0x7f7fbc1b41c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 >> 172.21.15.73:0/248956960 conn(0x7f7fbc0c5510 msgr2=0x7f7fbc0c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 shutdown_connections 2024-03-24T10:40:28.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.001 7f7fc279d700 1 -- 172.21.15.73:0/248956960 wait complete. 2024-03-24T10:40:28.007 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-03-24T10:40:28.013 INFO:tasks.ceph:Scrubbing osd.3 2024-03-24T10:40:28.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-24T10:40:28.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 Processor -- start 2024-03-24T10:40:28.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 -- start start 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 0x7ff45c10eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0f9220 con 0x7ff45c0f1eb0 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c10f0d0 con 0x7ff45c0f2300 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.141 7ff4642a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1ac670 con 0x7ff45c0f5910 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46189e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 0x7ff45c10eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57988/0 (socket says 172.21.15.73:57988) 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 -- 172.21.15.73:0/4258612204 learned_addr learned my addr 172.21.15.73:0/4258612204 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff44bfff700 1 -- 172.21.15.73:0/4258612204 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263409222 0 0) 0x7ff458001110 con 0x7ff45c0f1eb0 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 -- 172.21.15.73:0/4258612204 >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 msgr2=0x7ff45c10eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 --2- 172.21.15.73:0/4258612204 >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 0x7ff45c10eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 -- 172.21.15.73:0/4258612204 >> v1:172.21.15.73:6789/0 conn(0x7ff45c0f1eb0 legacy=0x7ff45c10e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 -- 172.21.15.73:0/4258612204 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c1ac820 con 0x7ff45c0f5910 2024-03-24T10:40:28.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46189e700 1 --2- 172.21.15.73:0/4258612204 >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 0x7ff45c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff46109d700 1 --2- 172.21.15.73:0/4258612204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff44c002f70 tx=0x7ff44c0099d0).ready entity=mon.1 client_cookie=1970769367301ce2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff44bfff700 1 -- 172.21.15.73:0/4258612204 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff45c1ac820 con 0x7ff45c0f5910 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff44bfff700 1 -- 172.21.15.73:0/4258612204 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00f510 con 0x7ff45c0f5910 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff44bfff700 1 -- 172.21.15.73:0/4258612204 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff44c00f6f0 con 0x7ff45c0f5910 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff4642a2700 1 -- 172.21.15.73:0/4258612204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 msgr2=0x7ff45c0f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.142 7ff4642a2700 1 --2- 172.21.15.73:0/4258612204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff44c002f70 tx=0x7ff44c0099d0).stop 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 -- 172.21.15.73:0/4258612204 shutdown_connections 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 --2- 172.21.15.73:0/4258612204 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c0f5910 0x7ff45c0f1880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 --2- 172.21.15.73:0/4258612204 >> v2:172.21.15.73:3300/0 conn(0x7ff45c0f2300 0x7ff45c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 -- 172.21.15.73:0/4258612204 >> 172.21.15.73:0/4258612204 conn(0x7ff45c113a60 msgr2=0x7ff45c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 -- 172.21.15.73:0/4258612204 shutdown_connections 2024-03-24T10:40:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.143 7ff4642a2700 1 -- 172.21.15.73:0/4258612204 wait complete. 2024-03-24T10:40:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.165 7ff4642a2700 1 Processor -- start 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 -- start start 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff45c0c3880 0x7ff45c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 0x7ff45c1b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 0x7ff45c1bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0d7e00 con 0x7ff45c0c4300 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0e0f20 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff4642a2700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1b5320 con 0x7ff45c0c3880 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46109d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff45c0c3880 0x7ff45c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46089c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 0x7ff45c1b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 0x7ff45c1bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46109d700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff45c0c3880 0x7ff45c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36596/0 (socket says 172.21.15.73:36596) 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46109d700 1 -- 172.21.15.73:0/1592621926 learned_addr learned my addr 172.21.15.73:0/1592621926 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46089c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 0x7ff45c1b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57740/0 (socket says 172.21.15.73:57740) 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 0x7ff45c1bbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:57990/0 (socket says 172.21.15.73:57990) 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 -- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff45c0c3880 msgr2=0x7ff45c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 --2- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7ff45c0c3880 0x7ff45c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 -- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 msgr2=0x7ff45c1b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 --2- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 0x7ff45c1b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 -- 172.21.15.73:0/1592621926 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c1b5550 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46089c700 1 --2- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff45c0c4300 0x7ff45c1b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.166 7ff46189e700 1 --2- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 0x7ff45c1bbd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff45400c000 tx=0x7ff45400ed40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff45c1b5550 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400c880 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c1bc330 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff45400f040 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c1bc710 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff454011070 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.167 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7ff454010040 con 0x7ff45c1b4ed0 2024-03-24T10:40:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.168 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 --> v1:172.21.15.73:6800/43869 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff45c087810 con 0x7ff45c0a7830 2024-03-24T10:40:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.168 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== osd.3 v1:172.21.15.73:6800/43869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7ff4580015e0 con 0x7ff45c0a7830 2024-03-24T10:40:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.174 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 --> v1:172.21.15.73:6800/43869 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7ff45c0f08d0 con 0x7ff45c0a7830 2024-03-24T10:40:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.174 7ff44a7fc700 1 -- 172.21.15.73:0/1592621926 <== osd.3 v1:172.21.15.73:6800/43869 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7ff45c0f08d0 con 0x7ff45c0a7830 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 >> v1:172.21.15.73:6800/43869 conn(0x7ff45c0a7830 legacy=0x7ff45c0a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 >> v1:172.21.15.73:6816/43277 conn(0x7ff43c0145b0 legacy=0x7ff43c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 msgr2=0x7ff45c1bbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 --2- 172.21.15.73:0/1592621926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff45c1b4ed0 0x7ff45c1bbd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff45400c000 tx=0x7ff45400ed40).stop 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff46189e700 1 -- 172.21.15.73:0/1592621926 reap_dead start 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 shutdown_connections 2024-03-24T10:40:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 >> 172.21.15.73:0/1592621926 conn(0x7ff45c0dc710 msgr2=0x7ff45c0bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 shutdown_connections 2024-03-24T10:40:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.175 7ff4642a2700 1 -- 172.21.15.73:0/1592621926 wait complete. 2024-03-24T10:40:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-03-24T10:40:28.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-24T10:40:28.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.312 7f4dd8bdb700 1 Processor -- start 2024-03-24T10:40:28.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.312 7f4dd8bdb700 1 -- start start 2024-03-24T10:40:28.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd410b900 0x7f4dd41a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4dd41a59c0 0x7f4dd41a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd410bd50 con 0x7f4dd40f5a00 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40fa580 con 0x7f4dd41a59c0 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a0c40 con 0x7f4dd410b900 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd1850700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4dd40f5a00 0x7f4dd410b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60406/0 (socket says 172.21.15.73:60406) 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd104f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd410b900 0x7f4dd41a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd1850700 1 -- 172.21.15.73:0/4020700898 learned_addr learned my addr 172.21.15.73:0/4020700898 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 --2- 172.21.15.73:0/4020700898 >> v2:172.21.15.73:3300/0 conn(0x7f4dd41a59c0 0x7f4dd41a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 -- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd410b900 msgr2=0x7f4dd41a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 --2- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd410b900 0x7f4dd41a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 -- 172.21.15.73:0/4020700898 >> v1:172.21.15.73:6789/0 conn(0x7f4dd40f5a00 legacy=0x7f4dd410b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 -- 172.21.15.73:0/4020700898 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd41a9460 con 0x7f4dd41a59c0 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd2051700 1 --2- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a59c0 0x7f4dd41a7e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4dc4001380 tx=0x7f4dc4001080).ready entity=mon.0 client_cookie=378f4afee2cce700 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd084e700 1 -- 172.21.15.73:0/4020700898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd41a9460 con 0x7f4dd41a59c0 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd084e700 1 -- 172.21.15.73:0/4020700898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00b6c0 con 0x7f4dd41a59c0 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd084e700 1 -- 172.21.15.73:0/4020700898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dcc00b8a0 con 0x7f4dd41a59c0 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 -- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a59c0 msgr2=0x7f4dd41a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.313 7f4dd8bdb700 1 --2- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a59c0 0x7f4dd41a7e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4dc4001380 tx=0x7f4dc4001080).stop 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 -- 172.21.15.73:0/4020700898 shutdown_connections 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 --2- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a59c0 0x7f4dd41a7e20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 --2- 172.21.15.73:0/4020700898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd410b900 0x7f4dd41a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 -- 172.21.15.73:0/4020700898 >> 172.21.15.73:0/4020700898 conn(0x7f4dd4113a60 msgr2=0x7f4dd40f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 -- 172.21.15.73:0/4020700898 shutdown_connections 2024-03-24T10:40:28.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.314 7f4dd8bdb700 1 -- 172.21.15.73:0/4020700898 wait complete. 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 Processor -- start 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 -- start start 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 0x7f4dd41b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41b51d0 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40ddf50 con 0x7f4dd41a8150 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd8bdb700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40ddc90 con 0x7f4dd41b4750 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd2051700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 0x7f4dd41b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57754/0 (socket says 172.21.15.73:57754) 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd1850700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:58002/0 (socket says 172.21.15.73:58002) 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 -- 172.21.15.73:0/2992441745 learned_addr learned my addr 172.21.15.73:0/2992441745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 -- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 msgr2=0x7f4dd41b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 0x7f4dd41b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 -- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 msgr2=0x7f4dd41a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd104f700 1 -- 172.21.15.73:0/2992441745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40cac50 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd1850700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.337 7f4dd2051700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 0x7f4dd41b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dd104f700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f4dd40ca7d0 tx=0x7f4dc800ecd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd40cac50 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800c9a0 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd40dd870 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dc800f040 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd41bba70 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4dc8011070 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.338 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f4dc8010040 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.339 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd40f08d0 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.342 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4dc800c5a0 con 0x7f4dd41a8bd0 2024-03-24T10:40:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.448 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mgr", ""]}) v1 -- 0x7f4dd4087740 con 0x7f4db00145b0 2024-03-24T10:40:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.448 7f4dc2ffd700 1 -- 172.21.15.73:0/2992441745 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f4dc40018a0 con 0x7f4db00145b0 2024-03-24T10:40:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 >> v1:172.21.15.73:6816/43277 conn(0x7f4db00145b0 legacy=0x7f4db0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 msgr2=0x7f4dd41b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f4dd40ca7d0 tx=0x7f4dc800ecd0).stop 2024-03-24T10:40:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 shutdown_connections 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f4dd41b4750 0x7f4dd41b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4dd41a8150 0x7f4dd41a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 --2- 172.21.15.73:0/2992441745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dd41a8bd0 0x7f4dd41b4120 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 >> 172.21.15.73:0/2992441745 conn(0x7f4dd40f1880 msgr2=0x7f4dd40c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 shutdown_connections 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.450 7f4dd8bdb700 1 -- 172.21.15.73:0/2992441745 wait complete. 2024-03-24T10:40:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-03-24T10:40:28.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:28.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 Processor -- start 2024-03-24T10:40:28.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 -- start start 2024-03-24T10:40:28.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7880f5a10 0x7fa78810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 0x7fa7881a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880fa590 con 0x7fa7880f5a10 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881a08a0 con 0x7fa78810bb90 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa78df3c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881a0ad0 con 0x7fa78810b740 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa786ced700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7880f5a10 0x7fa78810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa7864ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa7874ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 0x7fa7881a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa7864ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36608/0 (socket says 172.21.15.73:36608) 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa7864ec700 1 -- 172.21.15.73:0/93111811 learned_addr learned my addr 172.21.15.73:0/93111811 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.586 7fa786ced700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7880f5a10 0x7fa78810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57756/0 (socket says 172.21.15.73:57756) 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 -- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 msgr2=0x7fa78819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 -- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 msgr2=0x7fa7881a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:28.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 0x7fa7881a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 -- 172.21.15.73:0/93111811 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7881a73b0 con 0x7fa7880f5a10 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa7864ec700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa7874ee700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 0x7fa7881a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa786ced700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7880f5a10 0x7fa78810b110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa77c002f70 tx=0x7fa77c00ddb0).ready entity=mon.0 client_cookie=2904ef9b620a82d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa785ceb700 1 -- 172.21.15.73:0/93111811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7881a73b0 con 0x7fa7880f5a10 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa785ceb700 1 -- 172.21.15.73:0/93111811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c00f820 con 0x7fa7880f5a10 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa785ceb700 1 -- 172.21.15.73:0/93111811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa77c013070 con 0x7fa7880f5a10 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa78df3c700 1 -- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7880f5a10 msgr2=0x7fa78810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.587 7fa78df3c700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7880f5a10 0x7fa78810b110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa77c002f70 tx=0x7fa77c00ddb0).stop 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 -- 172.21.15.73:0/93111811 shutdown_connections 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa78810bb90 0x7fa7881a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7880f5a10 0x7fa78810b110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 --2- 172.21.15.73:0/93111811 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa78810b740 0x7fa78819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 -- 172.21.15.73:0/93111811 >> 172.21.15.73:0/93111811 conn(0x7fa788113a70 msgr2=0x7fa7880f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 -- 172.21.15.73:0/93111811 shutdown_connections 2024-03-24T10:40:28.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.588 7fa78df3c700 1 -- 172.21.15.73:0/93111811 wait complete. 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 Processor -- start 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 -- start start 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 0x7fa7881b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7881b08b0 0x7fa7881b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880dc4c0 con 0x7fa7881b08b0 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881b1330 con 0x7fa7880dd1a0 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa78df3c700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880dcba0 con 0x7fa7880cce30 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa786ced700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa7864ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 0x7fa7881b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa786ced700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:58030/0 (socket says 172.21.15.73:58030) 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa7864ec700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 0x7fa7881b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:36618/0 (socket says 172.21.15.73:36618) 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa786ced700 1 -- 172.21.15.73:0/787023023 learned_addr learned my addr 172.21.15.73:0/787023023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.611 7fa7874ee700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7881b08b0 0x7fa7881b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 -- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 msgr2=0x7fa7881b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 0x7fa7881b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 -- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7881b08b0 msgr2=0x7fa7881b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7881b08b0 0x7fa7881b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 -- 172.21.15.73:0/787023023 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7881b7760 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa786ced700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa7880c4550 tx=0x7fa77c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa7881b7760 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c017cb0 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa78df3c700 1 -- 172.21.15.73:0/787023023 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7881b7960 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa77c00b640 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.612 7fa78df3c700 1 -- 172.21.15.73:0/787023023 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7881b7d40 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.613 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa77c02b060 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.613 7fa78df3c700 1 -- 172.21.15.73:0/787023023 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880f08e0 con 0x7fa7880dd1a0 2024-03-24T10:40:28.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.613 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fa77c01caf0 con 0x7fa7880dd1a0 2024-03-24T10:40:28.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.616 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa77c0178b0 con 0x7fa7880dd1a0 2024-03-24T10:40:28.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.719 7fa78df3c700 1 -- 172.21.15.73:0/787023023 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa788087810 con 0x7fa7640145b0 2024-03-24T10:40:28.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.721 7fa777fff700 1 -- 172.21.15.73:0/787023023 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32330 (unknown 2965378022 0 3424148539) 0x7fa77800c800 con 0x7fa7640145b0 2024-03-24T10:40:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 >> v1:172.21.15.73:6816/43277 conn(0x7fa7640145b0 legacy=0x7fa764016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 msgr2=0x7fa7880cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa7880c4550 tx=0x7fa77c0068c0).stop 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 shutdown_connections 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7881b08b0 0x7fa7881b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7880dd1a0 0x7fa7880cc800 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 --2- 172.21.15.73:0/787023023 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7fa7880cce30 0x7fa7881b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:28.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 >> 172.21.15.73:0/787023023 conn(0x7fa7880c55e0 msgr2=0x7fa7880ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:28.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 shutdown_connections 2024-03-24T10:40:28.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:28.722 7fa78df3c700 1 -- 172.21.15.73:0/787023023 wait complete. 2024-03-24T10:40:28.724 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-24 10:40:27.125201","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195344,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292016,"statfs":{"total":386547056640,"available":382251024384,"internally_reserved":4294967296,"allocated":1015808,"data_stored":319928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.203278","last_change":"2024-03-24 10:39:13.168712","last_active":"2024-03-24 10:40:22.203278","last_peered":"2024-03-24 10:40:22.203278","last_clean":"2024-03-24 10:40:22.203278","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:22.203278","last_undegraded":"2024-03-24 10:40:22.203278","last_fullsized":"2024-03-24 10:40:22.203278","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.214129","last_change":"2024-03-24 10:39:13.173223","last_active":"2024-03-24 10:40:20.214129","last_peered":"2024-03-24 10:40:20.214129","last_clean":"2024-03-24 10:40:20.214129","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:20.214129","last_undegraded":"2024-03-24 10:40:20.214129","last_fullsized":"2024-03-24 10:40:20.214129","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.749444","last_change":"2024-03-24 10:39:13.172254","last_active":"2024-03-24 10:40:22.749444","last_peered":"2024-03-24 10:40:22.749444","last_clean":"2024-03-24 10:40:22.749444","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:22.749444","last_undegraded":"2024-03-24 10:40:22.749444","last_fullsized":"2024-03-24 10:40:22.749444","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.201302","last_change":"2024-03-24 10:39:13.173326","last_active":"2024-03-24 10:40:22.201302","last_peered":"2024-03-24 10:40:22.201302","last_clean":"2024-03-24 10:40:22.201302","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:22.201302","last_undegraded":"2024-03-24 10:40:22.201302","last_fullsized":"2024-03-24 10:40:22.201302","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.748643","last_change":"2024-03-24 10:39:13.172510","last_active":"2024-03-24 10:40:22.748643","last_peered":"2024-03-24 10:40:22.748643","last_clean":"2024-03-24 10:40:22.748643","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:22.748643","last_undegraded":"2024-03-24 10:40:22.748643","last_fullsized":"2024-03-24 10:40:22.748643","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.213883","last_change":"2024-03-24 10:39:13.173293","last_active":"2024-03-24 10:40:20.213883","last_peered":"2024-03-24 10:40:20.213883","last_clean":"2024-03-24 10:40:20.213883","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:20.213883","last_undegraded":"2024-03-24 10:40:20.213883","last_fullsized":"2024-03-24 10:40:20.213883","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.214545","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:20.214545","last_peered":"2024-03-24 10:40:20.214545","last_clean":"2024-03-24 10:40:20.214545","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:20.214545","last_undegraded":"2024-03-24 10:40:20.214545","last_fullsized":"2024-03-24 10:40:20.214545","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2024-03-24 10:40:22.749877","last_change":"2024-03-24 10:39:13.170953","last_active":"2024-03-24 10:40:22.749877","last_peered":"2024-03-24 10:40:22.749877","last_clean":"2024-03-24 10:40:22.749877","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:22.749877","last_undegraded":"2024-03-24 10:40:22.749877","last_fullsized":"2024-03-24 10:40:22.749877","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.219},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23100000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.377},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29899999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.34000000000000002}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.35199999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.25}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.312},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.27600000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.214},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.23499999999999999}]}]}]}} 2024-03-24T10:40:28.736 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:28.737 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-24T10:40:48.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:40:48.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 Processor -- start 2024-03-24T10:40:48.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 -- start start 2024-03-24T10:40:48.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21f010cb40 0x7f21f01a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:48.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01a6be0 0x7f21f01a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:48.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f010cf90 con 0x7f21f00f5920 2024-03-24T10:40:48.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f00fa290 con 0x7f21f010cb40 2024-03-24T10:40:48.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f77d4700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00f95c0 con 0x7f21f01a6be0 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21effff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f21f00f5920 0x7f21f010c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43082/0 (socket says 172.21.15.73:43082) 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21effff700 1 -- 172.21.15.73:0/3270531270 learned_addr learned my addr 172.21.15.73:0/3270531270 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21f4dd0700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01a6be0 0x7f21f01a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.879 7f21ef7fe700 1 --2- 172.21.15.73:0/3270531270 >> v2:172.21.15.73:3300/0 conn(0x7f21f010cb40 0x7f21f01a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21ef7fe700 1 -- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01a6be0 msgr2=0x7f21f01a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21ef7fe700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01a6be0 0x7f21f01a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21ef7fe700 1 -- 172.21.15.73:0/3270531270 >> v1:172.21.15.73:6789/0 conn(0x7f21f00f5920 legacy=0x7f21f010c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21ef7fe700 1 -- 172.21.15.73:0/3270531270 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f01aa680 con 0x7f21f010cb40 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21eeffd700 1 -- 172.21.15.73:0/3270531270 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783363770 0 0) 0x7f21e0001110 con 0x7f21f00f5920 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21ef7fe700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f010cb40 0x7f21f01a65b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f21f0113400 tx=0x7f21e400ba20).ready entity=mon.0 client_cookie=d0d25a0200e07144 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:48.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21eeffd700 1 -- 172.21.15.73:0/3270531270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21f01aa680 con 0x7f21f010cb40 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21eeffd700 1 -- 172.21.15.73:0/3270531270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e400d5c0 con 0x7f21f010cb40 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21eeffd700 1 -- 172.21.15.73:0/3270531270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21e400d990 con 0x7f21f010cb40 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21f77d4700 1 -- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f010cb40 msgr2=0x7f21f01a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.880 7f21f77d4700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f010cb40 0x7f21f01a65b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f21f0113400 tx=0x7f21e400ba20).stop 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 -- 172.21.15.73:0/3270531270 shutdown_connections 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01a6be0 0x7f21f01a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 --2- 172.21.15.73:0/3270531270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f010cb40 0x7f21f01a65b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 -- 172.21.15.73:0/3270531270 >> 172.21.15.73:0/3270531270 conn(0x7f21f0113a70 msgr2=0x7f21f00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 -- 172.21.15.73:0/3270531270 shutdown_connections 2024-03-24T10:40:48.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.881 7f21f77d4700 1 -- 172.21.15.73:0/3270531270 wait complete. 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.903 7f21f77d4700 1 Processor -- start 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 -- start start 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 0x7f21f01abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 0x7f21f01b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00f0250 con 0x7f21f00c3ea0 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00d4090 con 0x7f21f01ac1e0 2024-03-24T10:40:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f77d4700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00d00d0 con 0x7f21f01ac630 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21ef7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f4dd0700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 0x7f21f01b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21ef7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:56784/0 (socket says 172.21.15.73:56784) 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21ef7fe700 1 -- 172.21.15.73:0/3186112570 learned_addr learned my addr 172.21.15.73:0/3186112570 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21effff700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 0x7f21f01abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f4dd0700 1 -- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 msgr2=0x7f21f01b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.904 7f21f4dd0700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f4dd0700 1 -- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 msgr2=0x7f21f01abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f4dd0700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 0x7f21f01abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f4dd0700 1 -- 172.21.15.73:0/3186112570 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f01b31a0 con 0x7f21f01ac630 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ef7fe700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21effff700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 0x7f21f01abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f4dd0700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 0x7f21f01b2b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f21e800c000 tx=0x7f21e800ed50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21f01b31a0 con 0x7f21f01ac630 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800c830 con 0x7f21f01ac630 2024-03-24T10:40:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f01b34c0 con 0x7f21f01ac630 2024-03-24T10:40:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21e800f040 con 0x7f21f01ac630 2024-03-24T10:40:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01b9df0 con 0x7f21f01ac630 2024-03-24T10:40:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f21e8022060 con 0x7f21f01ac630 2024-03-24T10:40:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.905 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f21e8010040 con 0x7f21f01ac630 2024-03-24T10:40:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.906 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f00c46c0 con 0x7f21f01ac630 2024-03-24T10:40:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:48.909 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f21e800c620 con 0x7f21f01ac630 2024-03-24T10:40:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.010 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f21f0087810 con 0x7f21d00145b0 2024-03-24T10:40:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.012 7f21ed7fa700 1 -- 172.21.15.73:0/3186112570 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32319 (unknown 2965378022 0 2380025017) 0x7f21e0001580 con 0x7f21d00145b0 2024-03-24T10:40:49.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 >> v1:172.21.15.73:6816/43277 conn(0x7f21d00145b0 legacy=0x7f21d0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 msgr2=0x7f21f01b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 0x7f21f01b2b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f21e800c000 tx=0x7f21e800ed50).stop 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 shutdown_connections 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f21f01ac630 0x7f21f01b2b70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f00c3ea0 0x7f21f01abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 --2- 172.21.15.73:0/3186112570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21f01ac1e0 0x7f21f01b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:40:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 >> 172.21.15.73:0/3186112570 conn(0x7f21f00c5b70 msgr2=0x7f21f00d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:40:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 shutdown_connections 2024-03-24T10:40:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:40:49.013 7f21f77d4700 1 -- 172.21.15.73:0/3186112570 wait complete. 2024-03-24T10:40:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:40:49.024 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-03-24 10:40:47.129257","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195344,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292016,"statfs":{"total":386547056640,"available":382251024384,"internally_reserved":4294967296,"allocated":1015808,"data_stored":319928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:29.740651","last_change":"2024-03-24 10:40:29.740710","last_active":"2024-03-24 10:40:29.740651","last_peered":"2024-03-24 10:40:29.740651","last_clean":"2024-03-24 10:40:29.740651","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:29.740651","last_undegraded":"2024-03-24 10:40:29.740651","last_fullsized":"2024-03-24 10:40:29.740651","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:29.740651","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:29.740651","last_clean_scrub_stamp":"2024-03-24 10:40:29.740651","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:42.758743","last_change":"2024-03-24 10:40:42.758801","last_active":"2024-03-24 10:40:42.758743","last_peered":"2024-03-24 10:40:42.758743","last_clean":"2024-03-24 10:40:42.758743","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:42.758743","last_undegraded":"2024-03-24 10:40:42.758743","last_fullsized":"2024-03-24 10:40:42.758743","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:42.758743","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:42.758743","last_clean_scrub_stamp":"2024-03-24 10:40:42.758743","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:33.531463","last_change":"2024-03-24 10:40:33.531527","last_active":"2024-03-24 10:40:33.531463","last_peered":"2024-03-24 10:40:33.531463","last_clean":"2024-03-24 10:40:33.531463","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:33.531463","last_undegraded":"2024-03-24 10:40:33.531463","last_fullsized":"2024-03-24 10:40:33.531463","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:33.531463","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:33.531463","last_clean_scrub_stamp":"2024-03-24 10:40:33.531463","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:27.317463","last_change":"2024-03-24 10:40:27.317510","last_active":"2024-03-24 10:40:27.317463","last_peered":"2024-03-24 10:40:27.317463","last_clean":"2024-03-24 10:40:27.317463","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:27.317463","last_undegraded":"2024-03-24 10:40:27.317463","last_fullsized":"2024-03-24 10:40:27.317463","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:27.317463","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:27.317463","last_clean_scrub_stamp":"2024-03-24 10:40:27.317463","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:27.618301","last_change":"2024-03-24 10:40:27.618348","last_active":"2024-03-24 10:40:27.618301","last_peered":"2024-03-24 10:40:27.618301","last_clean":"2024-03-24 10:40:27.618301","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:27.618301","last_undegraded":"2024-03-24 10:40:27.618301","last_fullsized":"2024-03-24 10:40:27.618301","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:27.618301","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:27.618301","last_clean_scrub_stamp":"2024-03-24 10:40:27.618301","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:33.808380","last_change":"2024-03-24 10:40:33.808434","last_active":"2024-03-24 10:40:33.808380","last_peered":"2024-03-24 10:40:33.808380","last_clean":"2024-03-24 10:40:33.808380","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:33.808380","last_undegraded":"2024-03-24 10:40:33.808380","last_fullsized":"2024-03-24 10:40:33.808380","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:33.808380","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:33.808380","last_clean_scrub_stamp":"2024-03-24 10:40:33.808380","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-03-24 10:40:20.214545","last_change":"2024-03-24 10:39:13.172457","last_active":"2024-03-24 10:40:20.214545","last_peered":"2024-03-24 10:40:20.214545","last_clean":"2024-03-24 10:40:20.214545","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:20.214545","last_undegraded":"2024-03-24 10:40:20.214545","last_fullsized":"2024-03-24 10:40:20.214545","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:39:12.161444","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:39:12.161444","last_clean_scrub_stamp":"2024-03-24 10:39:12.161444","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:40.504700","last_change":"2024-03-24 10:40:40.504780","last_active":"2024-03-24 10:40:40.504700","last_peered":"2024-03-24 10:40:40.504700","last_clean":"2024-03-24 10:40:40.504700","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:40.504700","last_undegraded":"2024-03-24 10:40:40.504700","last_fullsized":"2024-03-24 10:40:40.504700","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:40.504700","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:40.504700","last_clean_scrub_stamp":"2024-03-24 10:40:40.504700","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705685,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.26000000000000001}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.32000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705686,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.41699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705685,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.439},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.43099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.28699999999999998}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.34300000000000003}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.32300000000000001}]}]}]}} 2024-03-24T10:40:49.025 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-03-24 10:39:12.161444 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=39, tm_sec=12, tm_wday=6, tm_yday=84, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=24, tm_hour=10, tm_min=40, tm_sec=25, tm_wday=6, tm_yday=84, tm_isdst=0) 2024-03-24T10:40:49.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-24T10:41:09.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:41:09.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.163 7f9120100700 1 Processor -- start 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.163 7f9120100700 1 -- start start 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.163 7f9120100700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 0x7f911810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.163 7f9120100700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f911810b740 0x7f911819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.163 7f9120100700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 0x7f91181a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9120100700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91180fa590 con 0x7f911810b740 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9120100700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91181a08a0 con 0x7f911810bb90 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9120100700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91181a0ad0 con 0x7f91180f5a10 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f911810b740 0x7f911819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f911d6fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 0x7f91181a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f911810b740 0x7f911819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52270/0 (socket says 172.21.15.73:52270) 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f911d6fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 0x7f91181a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:59942/0 (socket says 172.21.15.73:59942) 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 -- 172.21.15.73:0/3019776468 learned_addr learned my addr 172.21.15.73:0/3019776468 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:41:09.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f911cefb700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 0x7f911810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 -- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 msgr2=0x7f911810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 0x7f911810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 -- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 msgr2=0x7f91181a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 0x7f91181a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 -- 172.21.15.73:0/3019776468 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91181a73b0 con 0x7f911810b740 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f911cefb700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 0x7f911810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9117fff700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f911810b740 0x7f911819fc40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9100002f70 tx=0x7f9100009a50).ready entity=mon.0 client_cookie=fdbc5a623ab65e61 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f91177fe700 1 -- 172.21.15.73:0/3019776468 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91181a73b0 con 0x7f911810b740 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f91177fe700 1 -- 172.21.15.73:0/3019776468 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000f510 con 0x7f911810b740 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f91177fe700 1 -- 172.21.15.73:0/3019776468 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f910000f6f0 con 0x7f911810b740 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9120100700 1 -- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f911810b740 msgr2=0x7f911819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.164 7f9120100700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f911810b740 0x7f911819fc40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9100002f70 tx=0x7f9100009a50).stop 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 -- 172.21.15.73:0/3019776468 shutdown_connections 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f911810bb90 0x7f91181a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91180f5a10 0x7f911810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 --2- 172.21.15.73:0/3019776468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f911810b740 0x7f911819fc40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 -- 172.21.15.73:0/3019776468 >> 172.21.15.73:0/3019776468 conn(0x7f9118113a70 msgr2=0x7f91180f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 -- 172.21.15.73:0/3019776468 shutdown_connections 2024-03-24T10:41:09.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.165 7f9120100700 1 -- 172.21.15.73:0/3019776468 wait complete. 2024-03-24T10:41:09.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.188 7f9120100700 1 Processor -- start 2024-03-24T10:41:09.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.188 7f9120100700 1 -- start start 2024-03-24T10:41:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 0x7f91181b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91181b4980 0x7f91181b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180dd500 con 0x7f91181ae410 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91180c3b10 con 0x7f91181b4980 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9120100700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91180d3a20 con 0x7f91181ad990 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f911cefb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 0x7f91181b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f911cefb700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:51878/0 (socket says 172.21.15.73:51878) 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f911cefb700 1 -- 172.21.15.73:0/3995041401 learned_addr learned my addr 172.21.15.73:0/3995041401 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f911d6fc700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91181b4980 0x7f91181b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 -- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 msgr2=0x7f91181adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 -- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91181b4980 msgr2=0x7f91181b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91181b4980 0x7f91181b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 -- 172.21.15.73:0/3995041401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91180d4490 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f911cefb700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9117fff700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 0x7f91181b4350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f91180dd6b0 tx=0x7f91000068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91180d4490 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.189 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910001c650 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9120100700 1 -- 172.21.15.73:0/3995041401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91181bbac0 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f910001ca20 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9120100700 1 -- 172.21.15.73:0/3995041401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91181bbea0 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9100019030 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f9100018040 con 0x7f91181ae410 2024-03-24T10:41:09.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.190 7f9120100700 1 -- 172.21.15.73:0/3995041401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91180f08e0 con 0x7f91181ae410 2024-03-24T10:41:09.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.194 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f910001c440 con 0x7f91181ae410 2024-03-24T10:41:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.294 7f9120100700 1 -- 172.21.15.73:0/3995041401 --> v1:172.21.15.73:6816/43277 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f9118087810 con 0x7f90fc0145b0 2024-03-24T10:41:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.296 7f9115ffb700 1 -- 172.21.15.73:0/3995041401 <== mgr.4100 v1:172.21.15.73:6816/43277 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32291 (unknown 2965378022 0 2916499679) 0x7f9108008040 con 0x7f90fc0145b0 2024-03-24T10:41:09.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:41:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 >> v1:172.21.15.73:6816/43277 conn(0x7f90fc0145b0 legacy=0x7f90fc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 msgr2=0x7f91181b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 0x7f91181b4350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f91180dd6b0 tx=0x7f91000068c0).stop 2024-03-24T10:41:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 shutdown_connections 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91181b4980 0x7f91181b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f91181ad990 0x7f91181adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 --2- 172.21.15.73:0/3995041401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91181ae410 0x7f91181b4350 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 >> 172.21.15.73:0/3995041401 conn(0x7f91180c5560 msgr2=0x7f91181a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 shutdown_connections 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.297 7f9120100700 1 -- 172.21.15.73:0/3995041401 wait complete. 2024-03-24T10:41:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-24T10:41:09.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-03-24 10:41:09.133661","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195344,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292016,"statfs":{"total":386547056640,"available":382251024384,"internally_reserved":4294967296,"allocated":1015808,"data_stored":319928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.075297"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:29.740651","last_change":"2024-03-24 10:40:29.740710","last_active":"2024-03-24 10:40:29.740651","last_peered":"2024-03-24 10:40:29.740651","last_clean":"2024-03-24 10:40:29.740651","last_became_active":"2024-03-24 10:39:13.168345","last_became_peered":"2024-03-24 10:39:13.168345","last_unstale":"2024-03-24 10:40:29.740651","last_undegraded":"2024-03-24 10:40:29.740651","last_fullsized":"2024-03-24 10:40:29.740651","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:29.740651","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:29.740651","last_clean_scrub_stamp":"2024-03-24 10:40:29.740651","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:42.758743","last_change":"2024-03-24 10:40:42.758801","last_active":"2024-03-24 10:40:42.758743","last_peered":"2024-03-24 10:40:42.758743","last_clean":"2024-03-24 10:40:42.758743","last_became_active":"2024-03-24 10:39:13.172911","last_became_peered":"2024-03-24 10:39:13.172911","last_unstale":"2024-03-24 10:40:42.758743","last_undegraded":"2024-03-24 10:40:42.758743","last_fullsized":"2024-03-24 10:40:42.758743","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:42.758743","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:42.758743","last_clean_scrub_stamp":"2024-03-24 10:40:42.758743","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:33.531463","last_change":"2024-03-24 10:40:33.531527","last_active":"2024-03-24 10:40:33.531463","last_peered":"2024-03-24 10:40:33.531463","last_clean":"2024-03-24 10:40:33.531463","last_became_active":"2024-03-24 10:39:13.171914","last_became_peered":"2024-03-24 10:39:13.171914","last_unstale":"2024-03-24 10:40:33.531463","last_undegraded":"2024-03-24 10:40:33.531463","last_fullsized":"2024-03-24 10:40:33.531463","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:33.531463","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:33.531463","last_clean_scrub_stamp":"2024-03-24 10:40:33.531463","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:27.317463","last_change":"2024-03-24 10:40:27.317510","last_active":"2024-03-24 10:40:27.317463","last_peered":"2024-03-24 10:40:27.317463","last_clean":"2024-03-24 10:40:27.317463","last_became_active":"2024-03-24 10:39:13.173016","last_became_peered":"2024-03-24 10:39:13.173016","last_unstale":"2024-03-24 10:40:27.317463","last_undegraded":"2024-03-24 10:40:27.317463","last_fullsized":"2024-03-24 10:40:27.317463","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:27.317463","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:27.317463","last_clean_scrub_stamp":"2024-03-24 10:40:27.317463","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:27.618301","last_change":"2024-03-24 10:40:27.618348","last_active":"2024-03-24 10:40:27.618301","last_peered":"2024-03-24 10:40:27.618301","last_clean":"2024-03-24 10:40:27.618301","last_became_active":"2024-03-24 10:39:13.172200","last_became_peered":"2024-03-24 10:39:13.172200","last_unstale":"2024-03-24 10:40:27.618301","last_undegraded":"2024-03-24 10:40:27.618301","last_fullsized":"2024-03-24 10:40:27.618301","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:27.618301","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:27.618301","last_clean_scrub_stamp":"2024-03-24 10:40:27.618301","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:33.808380","last_change":"2024-03-24 10:40:33.808434","last_active":"2024-03-24 10:40:33.808380","last_peered":"2024-03-24 10:40:33.808380","last_clean":"2024-03-24 10:40:33.808380","last_became_active":"2024-03-24 10:39:13.172975","last_became_peered":"2024-03-24 10:39:13.172975","last_unstale":"2024-03-24 10:40:33.808380","last_undegraded":"2024-03-24 10:40:33.808380","last_fullsized":"2024-03-24 10:40:33.808380","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:33.808380","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:33.808380","last_clean_scrub_stamp":"2024-03-24 10:40:33.808380","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:48.628564","last_change":"2024-03-24 10:40:48.628641","last_active":"2024-03-24 10:40:48.628564","last_peered":"2024-03-24 10:40:48.628564","last_clean":"2024-03-24 10:40:48.628564","last_became_active":"2024-03-24 10:39:13.172132","last_became_peered":"2024-03-24 10:39:13.172132","last_unstale":"2024-03-24 10:40:48.628564","last_undegraded":"2024-03-24 10:40:48.628564","last_fullsized":"2024-03-24 10:40:48.628564","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:48.628564","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:48.628564","last_clean_scrub_stamp":"2024-03-24 10:40:48.628564","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-03-24 10:40:40.504700","last_change":"2024-03-24 10:40:40.504780","last_active":"2024-03-24 10:40:40.504700","last_peered":"2024-03-24 10:40:40.504700","last_clean":"2024-03-24 10:40:40.504700","last_became_active":"2024-03-24 10:39:13.170589","last_became_peered":"2024-03-24 10:39:13.170589","last_unstale":"2024-03-24 10:40:40.504700","last_undegraded":"2024-03-24 10:40:40.504700","last_fullsized":"2024-03-24 10:40:40.504700","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24 10:40:40.504700","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24 10:40:40.504700","last_clean_scrub_stamp":"2024-03-24 10:40:40.504700","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705689,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Sun Mar 24 10:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.27500000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705690,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.28199999999999997}]},{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.308},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.27100000000000002}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.30099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.378}]},{"osd":3,"last update":"Sun Mar 24 10:40:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.41799999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705690,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.245,"15min":0.245},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.25,"15min":0.25},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.252}]},{"osd":2,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.311},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"last":0.29299999999999998}]},{"osd":3,"last update":"Sun Mar 24 10:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"last":0.28000000000000003}]}]}]}} 2024-03-24T10:41:09.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.433 7f17a4f9a700 1 Processor -- start 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 -- start start 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 0x7f17a01a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01a59d0 0x7f17a01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a010bd60 con 0x7f17a00f5a10 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00fa590 con 0x7f17a01a59d0 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f17a4f9a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01a0c50 con 0x7f17a010b910 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179d576700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 0x7f17a01a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179dd77700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f17a00f5a10 0x7f17a010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50066/0 (socket says 172.21.15.73:50066) 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179dd77700 1 -- 172.21.15.73:0/939240819 learned_addr learned my addr 172.21.15.73:0/939240819 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-24T10:41:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179e578700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01a59d0 0x7f17a01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179cd75700 1 -- 172.21.15.73:0/939240819 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271481778 0 0) 0x7f1794001110 con 0x7f17a00f5a10 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179cd75700 1 -- 172.21.15.73:0/939240819 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784003270 con 0x7f17a00f5a10 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179d576700 1 -- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01a59d0 msgr2=0x7f17a01a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179d576700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01a59d0 0x7f17a01a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179d576700 1 -- 172.21.15.73:0/939240819 >> v1:172.21.15.73:6789/0 conn(0x7f17a00f5a10 legacy=0x7f17a010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.434 7f179d576700 1 -- 172.21.15.73:0/939240819 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a01a9470 con 0x7f17a010b910 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f179d576700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 0x7f17a01a53a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f17a00f47c0 tx=0x7f179000b9d0).ready entity=mon.2 client_cookie=d3b2faefc828c304 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f179cd75700 1 -- 172.21.15.73:0/939240819 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17a01a9470 con 0x7f17a010b910 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f179cd75700 1 -- 172.21.15.73:0/939240819 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179000d570 con 0x7f17a010b910 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f179cd75700 1 -- 172.21.15.73:0/939240819 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f179000d940 con 0x7f17a010b910 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 -- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 msgr2=0x7f17a01a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 0x7f17a01a53a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f17a00f47c0 tx=0x7f179000b9d0).stop 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 -- 172.21.15.73:0/939240819 shutdown_connections 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01a59d0 0x7f17a01a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 --2- 172.21.15.73:0/939240819 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a010b910 0x7f17a01a53a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 -- 172.21.15.73:0/939240819 >> 172.21.15.73:0/939240819 conn(0x7f17a0113a70 msgr2=0x7f17a00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 -- 172.21.15.73:0/939240819 shutdown_connections 2024-03-24T10:41:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.435 7f17a4f9a700 1 -- 172.21.15.73:0/939240819 wait complete. 2024-03-24T10:41:09.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.458 7f17a4f9a700 1 Processor -- start 2024-03-24T10:41:09.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.458 7f17a4f9a700 1 -- start start 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01aaf90 0x7f17a01b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 0x7f17a01b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00dee50 con 0x7f17a01ab3e0 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00e0cf0 con 0x7f17a01aaf90 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f17a4f9a700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01b1f40 con 0x7f17a00e08a0 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:51886/0 (socket says 172.21.15.73:51886) 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 -- 172.21.15.73:0/725503267 learned_addr learned my addr 172.21.15.73:0/725503267 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:41:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179e578700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 0x7f17a01b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179d576700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01aaf90 0x7f17a01b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 -- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01aaf90 msgr2=0x7f17a01b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01aaf90 0x7f17a01b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 -- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 msgr2=0x7f17a01b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 0x7f17a01b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179dd77700 1 -- 172.21.15.73:0/725503267 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a01b2170 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.459 7f179e578700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 0x7f17a01b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f179dd77700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f17a00c5670 tx=0x7f179400e9a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17a01b2170 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17940072e0 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00f1890 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1794005810 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a00f1d90 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1794018020 con 0x7f17a00e08a0 2024-03-24T10:41:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.460 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f1794006a20 con 0x7f17a00e08a0 2024-03-24T10:41:09.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.461 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00f08e0 con 0x7f17a00e08a0 2024-03-24T10:41:09.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.464 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f17940070d0 con 0x7f17a00e08a0 2024-03-24T10:41:09.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.569 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f17a00d4680 con 0x7f17a00e08a0 2024-03-24T10:41:09.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.577 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f179400c6d0 con 0x7f17a00e08a0 2024-03-24T10:41:09.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.578 7f178effd700 1 -- 172.21.15.73:0/725503267 <== mon.2 v2:172.21.15.73:3302/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f17a00fefc0 con 0x7f17a00e08a0 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 >> v1:172.21.15.73:6816/43277 conn(0x7f177c0145b0 legacy=0x7f177c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 msgr2=0x7f17a01aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f17a00c5670 tx=0x7f179400e9a0).stop 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 shutdown_connections 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17a01ab3e0 0x7f17a01b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f17a00e08a0 0x7f17a01aa960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 --2- 172.21.15.73:0/725503267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17a01aaf90 0x7f17a01b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 >> 172.21.15.73:0/725503267 conn(0x7f17a00c9470 msgr2=0x7f17a00d74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 shutdown_connections 2024-03-24T10:41:09.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.579 7f17a4f9a700 1 -- 172.21.15.73:0/725503267 wait complete. 2024-03-24T10:41:09.591 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-24T10:41:09.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:41:09.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.716 7f08c87ee700 1 Processor -- start 2024-03-24T10:41:09.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 -- start start 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08c010b740 0x7f08c019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c01a0a70 con 0x7f08c010bb90 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c00fa590 con 0x7f08c010b740 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c87ee700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01a0c90 con 0x7f08c00f5a10 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c55e9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c4de8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08c010b740 0x7f08c019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c55e9700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:51898/0 (socket says 172.21.15.73:51898) 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c5dea700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f08c010bb90 0x7f08c01a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50072/0 (socket says 172.21.15.73:50072) 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.717 7f08c55e9700 1 -- 172.21.15.73:0/2238302085 learned_addr learned my addr 172.21.15.73:0/2238302085 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c55e9700 1 -- 172.21.15.73:0/2238302085 >> v2:172.21.15.73:3300/0 conn(0x7f08c010b740 msgr2=0x7f08c019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c55e9700 1 --2- 172.21.15.73:0/2238302085 >> v2:172.21.15.73:3300/0 conn(0x7f08c010b740 0x7f08c019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08affff700 1 -- 172.21.15.73:0/2238302085 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984522806 0 0) 0x7f08b8001490 con 0x7f08c010bb90 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c55e9700 1 -- 172.21.15.73:0/2238302085 >> v1:172.21.15.73:6789/0 conn(0x7f08c010bb90 legacy=0x7f08c01a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c55e9700 1 -- 172.21.15.73:0/2238302085 --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c01a93d0 con 0x7f08c00f5a10 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c55e9700 1 --2- 172.21.15.73:0/2238302085 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f08bc002f70 tx=0x7f08bc0099d0).ready entity=mon.2 client_cookie=1f824001c267e88d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08affff700 1 -- 172.21.15.73:0/2238302085 <== mon.2 v2:172.21.15.73:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c01a93d0 con 0x7f08c00f5a10 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08affff700 1 -- 172.21.15.73:0/2238302085 <== mon.2 v2:172.21.15.73:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08bc00f510 con 0x7f08c00f5a10 2024-03-24T10:41:09.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08affff700 1 -- 172.21.15.73:0/2238302085 <== mon.2 v2:172.21.15.73:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08bc00f6f0 con 0x7f08c00f5a10 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c87ee700 1 -- 172.21.15.73:0/2238302085 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 msgr2=0x7f08c010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c87ee700 1 --2- 172.21.15.73:0/2238302085 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f08bc002f70 tx=0x7f08bc0099d0).stop 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.718 7f08c87ee700 1 -- 172.21.15.73:0/2238302085 shutdown_connections 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.719 7f08c87ee700 1 --2- 172.21.15.73:0/2238302085 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00f5a10 0x7f08c010b110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.719 7f08c87ee700 1 --2- 172.21.15.73:0/2238302085 >> v2:172.21.15.73:3300/0 conn(0x7f08c010b740 0x7f08c019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.719 7f08c87ee700 1 -- 172.21.15.73:0/2238302085 >> 172.21.15.73:0/2238302085 conn(0x7f08c0113a70 msgr2=0x7f08c00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.719 7f08c87ee700 1 -- 172.21.15.73:0/2238302085 shutdown_connections 2024-03-24T10:41:09.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.719 7f08c87ee700 1 -- 172.21.15.73:0/2238302085 wait complete. 2024-03-24T10:41:09.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.741 7f08c87ee700 1 Processor -- start 2024-03-24T10:41:09.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.741 7f08c87ee700 1 -- start start 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 0x7f08c00d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08c00d21f0 0x7f08c00da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00e6600 con 0x7f08c00d21f0 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00db3a0 con 0x7f08c01a47d0 2024-03-24T10:41:09.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c87ee700 1 -- --> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00daf20 con 0x7f08c00d1da0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c4de8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 0x7f08c00d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c4de8700 1 --2- >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.73:3302/0 says I am v2:172.21.15.73:51904/0 (socket says 172.21.15.73:51904) 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c4de8700 1 -- 172.21.15.73:0/1658200591 learned_addr learned my addr 172.21.15.73:0/1658200591 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c5dea700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08c00d21f0 0x7f08c00da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 -- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 msgr2=0x7f08c00da2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 -- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08c00d21f0 msgr2=0x7f08c00da8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08c00d21f0 0x7f08c00da8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 -- 172.21.15.73:0/1658200591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00db100 con 0x7f08c01a47d0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c4de8700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.742 7f08c55e9700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 0x7f08c00d1770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f08c00c42f0 tx=0x7f08bc0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08c00db100 con 0x7f08c01a47d0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08bc00f840 con 0x7f08c01a47d0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c01b76b0 con 0x7f08c01a47d0 2024-03-24T10:41:09.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08bc021070 con 0x7f08c01a47d0 2024-03-24T10:41:09.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c01b7a90 con 0x7f08c01a47d0 2024-03-24T10:41:09.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f08bc00fc10 con 0x7f08c01a47d0 2024-03-24T10:41:09.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.743 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f08bc027a70 con 0x7f08c01a47d0 2024-03-24T10:41:09.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.744 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c00f08e0 con 0x7f08c01a47d0 2024-03-24T10:41:09.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.747 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f08bc00f300 con 0x7f08c01a47d0 2024-03-24T10:41:09.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.881 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08c01aa740 con 0x7f08c01a47d0 2024-03-24T10:41:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.882 7f08ae7fc700 1 -- 172.21.15.73:0/1658200591 <== mon.1 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+780 (secure 0 0 0) 0x7f08bc01b110 con 0x7f08c01a47d0 2024-03-24T10:41:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-24T10:41:09.883 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6817/1869811739","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6817","nonce":1869811739}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":14}],"filesystems":[]} 2024-03-24T10:41:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 >> v1:172.21.15.73:6816/43277 conn(0x7f08a0014700 legacy=0x7f08a0016c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 msgr2=0x7f08c00d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:41:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 0x7f08c00d1770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f08c00c42f0 tx=0x7f08bc0068c0).stop 2024-03-24T10:41:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 shutdown_connections 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08c00d21f0 0x7f08c00da8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08c01a47d0 0x7f08c00d1770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 --2- 172.21.15.73:0/1658200591 >> [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] conn(0x7f08c00d1da0 0x7f08c00da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 >> 172.21.15.73:0/1658200591 conn(0x7f08c00c4af0 msgr2=0x7f08c00e0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 shutdown_connections 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-24 10:41:09.883 7f08c87ee700 1 -- 172.21.15.73:0/1658200591 wait complete. 2024-03-24T10:41:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 14 2024-03-24T10:41:09.895 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-24T10:41:09.895 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-24T10:41:09.895 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-24T10:41:09.895 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:09.903 INFO:tasks.ceph.mds.a:Stopped 2024-03-24T10:41:09.903 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-24T10:41:09.903 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-24T10:41:09.904 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:09.976 INFO:tasks.ceph.osd.0:Stopped 2024-03-24T10:41:09.976 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-24T10:41:09.976 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.044 INFO:tasks.ceph.osd.1:Stopped 2024-03-24T10:41:10.044 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-24T10:41:10.044 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.106 INFO:tasks.ceph.osd.2:Stopped 2024-03-24T10:41:10.106 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-24T10:41:10.107 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.174 INFO:tasks.ceph.osd.3:Stopped 2024-03-24T10:41:10.174 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-24T10:41:10.175 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-24T10:41:10.175 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.232 INFO:tasks.ceph.mgr.x:Stopped 2024-03-24T10:41:10.233 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-24T10:41:10.233 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-24T10:41:10.233 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.282 INFO:tasks.ceph.mon.a:Stopped 2024-03-24T10:41:10.283 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-24T10:41:10.283 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.332 INFO:tasks.ceph.mon.b:Stopped 2024-03-24T10:41:10.332 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-24T10:41:10.333 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:41:10.382 INFO:tasks.ceph.mon.c:Stopped 2024-03-24T10:41:10.382 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-24T10:41:10.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-24T10:41:10.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:41:10.458 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-24T10:41:10.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:41:10.700 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-24T10:41:10.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:41:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-24T10:41:10.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:41:10.855 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-24T10:41:10.928 INFO:tasks.ceph:Archiving mon data... 2024-03-24T10:41:10.929 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/data/mon.a.tgz 2024-03-24T10:41:10.929 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-24T10:41:10.947 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.5ZXk9fULcg 2024-03-24T10:41:10.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5ZXk9fULcg 2024-03-24T10:41:11.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.5ZXk9fULcg 2024-03-24T10:41:11.155 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.5ZXk9fULcg is 256KB 2024-03-24T10:41:11.248 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.5ZXk9fULcg 2024-03-24T10:41:11.266 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/data/mon.b.tgz 2024-03-24T10:41:11.266 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-24T10:41:11.322 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.qOrAShCGmm 2024-03-24T10:41:11.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.qOrAShCGmm 2024-03-24T10:41:11.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.qOrAShCGmm 2024-03-24T10:41:11.552 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.qOrAShCGmm is 339KB 2024-03-24T10:41:11.647 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.qOrAShCGmm 2024-03-24T10:41:11.665 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/data/mon.c.tgz 2024-03-24T10:41:11.665 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-24T10:41:11.723 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Uxwv81gipt 2024-03-24T10:41:11.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Uxwv81gipt 2024-03-24T10:41:11.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Uxwv81gipt 2024-03-24T10:41:11.949 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Uxwv81gipt is 339KB 2024-03-24T10:41:12.044 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Uxwv81gipt 2024-03-24T10:41:12.061 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-24T10:41:12.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-24T10:41:12.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-24T10:41:12.202 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-24T10:41:12.252 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-24T10:41:12.253 INFO:tasks.ceph:Archiving crash dumps... 2024-03-24T10:41:12.254 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi073/crash 2024-03-24T10:41:12.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-24T10:41:12.282 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi078/crash 2024-03-24T10:41:12.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-24T10:41:12.421 INFO:tasks.ceph:Compressing logs... 2024-03-24T10:41:12.421 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-24T10:41:12.424 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-24T10:41:12.448 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50690.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50690.log.gz 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47322.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2024-03-24T10:41:12.481 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51964.log: /var/log/ceph/ceph-client.admin.45835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49352.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49352.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51059.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53002.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49352.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45784.log 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2024-03-24T10:41:12.482 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49454.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51059.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49454.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45784.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44957.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49454.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49710.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50743.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44957.log: /var/log/ceph/ceph-client.admin.49710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44957.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49710.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49777.log: gzip -5 87.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50743.log.gz/var/log/ceph/ceph-client.admin.51570.log 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51212.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2024-03-24T10:41:12.483 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44536.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51570.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53461.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50074.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53461.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2%/var/log/ceph/ceph-client.admin.50074.log: -- replaced with /var/log/ceph/ceph-client.admin.53461.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50074.log.gz 2024-03-24T10:41:12.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45264.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44734.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47373.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51110.log 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-03-24T10:41:12.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.41087.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51110.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51110.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.41087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.41087.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51416.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47994.log 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51416.log.gz 2024-03-24T10:41:12.486 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48606.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4%/var/log/ceph/ceph-client.admin.47994.log: -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50588.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47994.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48606.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45529.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46422.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50588.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45529.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51519.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45529.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51519.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46422.log.gz 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52117.log 2024-03-24T10:41:12.487 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51519.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52321.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53571.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52321.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52117.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49556.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52321.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49556.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53571.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47790.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49556.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50227.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52644.log 2024-03-24T10:41:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50227.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46370.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48198.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50227.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52644.log: /var/log/ceph/ceph-client.admin.46370.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52644.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46370.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52015.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48198.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48351.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48945.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52015.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2024-03-24T10:41:12.489 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52015.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47892.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48945.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47892.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53206.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47892.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46549.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51161.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46549.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53206.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49199.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46549.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51161.log: /var/log/ceph/ceph-client.admin.49199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2024-03-24T10:41:12.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49199.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50537.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46644.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50537.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46644.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45478.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46218.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48147.log 2024-03-24T10:41:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50906.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48147.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46965.log: /var/log/ceph/ceph-client.admin.50906.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50906.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47526.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43868.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47526.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51710.log 2024-03-24T10:41:12.492 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45937.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51710.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51710.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49403.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47943.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0%/var/log/ceph/ceph-client.admin.49403.log: -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49403.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47943.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47943.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50796.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5%/var/log/ceph/ceph-client.admin.50333.log: -- replaced with /var/log/ceph/ceph-client.admin.50796.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53257.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-03-24T10:41:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5%/var/log/ceph/ceph-client.admin.50486.log: -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51914.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49904.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51914.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51914.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49904.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-03-24T10:41:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2024-03-24T10:41:12.495 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2024-03-24T10:41:12.495 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50281.log: /var/log/ceph/ceph-client.admin.48504.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-03-24T10:41:12.501 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2024-03-24T10:41:12.501 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-24T10:41:12.501 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-03-24T10:41:12.501 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46863.log: /var/log/ceph/ceph-client.admin.52797.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44803.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47118.log: /var/log/ceph/ceph-client.admin.44803.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44803.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53053.log: /var/log/ceph/ceph-client.admin.47739.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53308.log 2024-03-24T10:41:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46217.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53308.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53308.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51263.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51263.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51632.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.51263.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52423.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52423.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48300.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52423.log.gz 2024-03-24T10:41:12.503 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50435.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53520.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50435.log: /var/log/ceph/ceph-client.admin.53520.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.53520.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48453.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48453.log: /var/log/ceph/ceph-client.admin.46914.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48453.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.48402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49828.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46216.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-03-24T10:41:12.504 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49828.log.gz 2024-03-24T10:41:12.505 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-24T10:41:12.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-03-24T10:41:12.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-24T10:41:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36331.log 2024-03-24T10:41:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35708.log 2024-03-24T10:41:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.36331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36331.log.gz 2024-03-24T10:41:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.35708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35708.log.gz 2024-03-24T10:41:12.506 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-03-24T10:41:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.031s 2024-03-24T10:41:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m0.007s 2024-03-24T10:41:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.049s 2024-03-24T10:41:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-03-24T10:41:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46219.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-03-24T10:41:12.512 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50125.log 2024-03-24T10:41:12.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50125.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50125.log.gz 2024-03-24T10:41:12.513 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51812.log 2024-03-24T10:41:12.513 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-24T10:41:12.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2024-03-24T10:41:12.514 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51812.log.gz 2024-03-24T10:41:12.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-03-24T10:41:12.515 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2024-03-24T10:41:12.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2024-03-24T10:41:12.515 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-03-24T10:41:12.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52848.log 2024-03-24T10:41:12.516 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2024-03-24T10:41:12.516 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2024-03-24T10:41:12.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52848.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52848.log.gz 2024-03-24T10:41:12.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48045.log 2024-03-24T10:41:12.517 INFO:teuthology.orchestra.run.smithi073.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-03-24T10:41:12.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48045.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48045.log.gz 2024-03-24T10:41:12.519 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-24T10:41:12.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46761.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47424.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47424.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43615.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45008.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44905.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50639.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-03-24T10:41:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2024-03-24T10:41:12.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48096.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2024-03-24T10:41:12.527 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-24T10:41:12.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-24T10:41:12.531 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47067.log 2024-03-24T10:41:12.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47067.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2024-03-24T10:41:12.532 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2024-03-24T10:41:12.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52066.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz 2024-03-24T10:41:12.534 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49505.log 2024-03-24T10:41:12.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49505.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49505.log.gz 2024-03-24T10:41:12.535 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-03-24T10:41:12.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43665.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-03-24T10:41:12.536 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-03-24T10:41:12.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45733.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-03-24T10:41:12.537 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2024-03-24T10:41:12.538 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52219.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz 2024-03-24T10:41:12.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53104.log 2024-03-24T10:41:12.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53104.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53104.log.gz 2024-03-24T10:41:12.540 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52899.log 2024-03-24T10:41:12.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52899.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.52899.log.gz 2024-03-24T10:41:12.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49972.log 2024-03-24T10:41:12.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49972.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49972.log.gz 2024-03-24T10:41:12.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-03-24T10:41:12.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45110.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-03-24T10:41:12.544 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2024-03-24T10:41:12.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44854.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2024-03-24T10:41:12.545 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52950.log 2024-03-24T10:41:12.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52950.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.52950.log.gz 2024-03-24T10:41:12.546 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2024-03-24T10:41:12.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48759.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2024-03-24T10:41:12.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2024-03-24T10:41:12.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45886.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2024-03-24T10:41:12.549 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50384.log 2024-03-24T10:41:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50384.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50384.log.gz 2024-03-24T10:41:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2024-03-24T10:41:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51863.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz 2024-03-24T10:41:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50023.log 2024-03-24T10:41:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50023.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50023.log.gz 2024-03-24T10:41:12.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-03-24T10:41:12.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43966.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-03-24T10:41:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53410.log 2024-03-24T10:41:12.554 INFO:teuthology.orchestra.run.smithi073.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-24T10:41:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53410.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53410.log.gz 2024-03-24T10:41:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2024-03-24T10:41:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47688.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2024-03-24T10:41:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2024-03-24T10:41:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49301.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-03-24T10:41:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46371.log 2024-03-24T10:41:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46371.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46371.log.gz 2024-03-24T10:41:12.558 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51314.log 2024-03-24T10:41:12.558 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51314.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51314.log.gz 2024-03-24T10:41:12.559 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2024-03-24T10:41:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46090.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2024-03-24T10:41:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49097.log 2024-03-24T10:41:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49097.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2024-03-24T10:41:12.561 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45211.log 2024-03-24T10:41:12.561 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45211.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45211.log.gz 2024-03-24T10:41:12.562 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48996.log 2024-03-24T10:41:12.562 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48996.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48996.log.gz 2024-03-24T10:41:12.563 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-03-24T10:41:12.563 INFO:teuthology.orchestra.run.smithi073.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-24T10:41:12.563 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51468.log 2024-03-24T10:41:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-03-24T10:41:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-03-24T10:41:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51468.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51468.log.gz 2024-03-24T10:41:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51365.log 2024-03-24T10:41:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52168.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-03-24T10:41:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52695.log 2024-03-24T10:41:12.565 INFO:teuthology.orchestra.run.smithi073.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51365.log.gz 2024-03-24T10:41:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45631.log 2024-03-24T10:41:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52695.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52695.log.gz 2024-03-24T10:41:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45631.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-24T10:41:12.566 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2024-03-24T10:41:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-03-24T10:41:12.567 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.45161.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-03-24T10:41:12.567 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49148.log 2024-03-24T10:41:12.568 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49148.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49148.log.gz 2024-03-24T10:41:12.568 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2024-03-24T10:41:12.569 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45988.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2024-03-24T10:41:12.569 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2024-03-24T10:41:12.570 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53155.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz 2024-03-24T10:41:12.570 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52525.log 2024-03-24T10:41:12.571 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52525.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52525.log.gz 2024-03-24T10:41:12.571 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-03-24T10:41:12.572 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48555.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-03-24T10:41:12.572 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45580.log 2024-03-24T10:41:12.573 INFO:teuthology.orchestra.run.smithi073.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-24T10:41:12.573 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45580.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45580.log.gz 2024-03-24T10:41:12.573 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49607.log 2024-03-24T10:41:12.574 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-03-24T10:41:12.574 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49607.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49607.log.gz 2024-03-24T10:41:12.575 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44658.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-03-24T10:41:12.575 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2024-03-24T10:41:12.575 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-03-24T10:41:12.576 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47586.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-03-24T10:41:12.576 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45317.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-03-24T10:41:12.587 INFO:teuthology.orchestra.run.smithi073.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-24T10:41:12.591 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-24T10:41:12.603 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-24T10:41:12.616 INFO:teuthology.orchestra.run.smithi073.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-24T10:41:12.653 INFO:teuthology.orchestra.run.smithi073.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-24T10:41:12.655 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-24T10:41:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m0.216s 2024-03-24T10:41:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m0.862s 2024-03-24T10:41:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.135s 2024-03-24T10:41:12.656 INFO:tasks.ceph:Archiving logs... 2024-03-24T10:41:12.656 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi073/log 2024-03-24T10:41:12.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-24T10:41:12.969 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi078/log 2024-03-24T10:41:12.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-24T10:41:13.042 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-24T10:41:13.062 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-24T10:41:13.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-24T10:41:13.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-24T10:41:13.177 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-24T10:41:13.187 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-24T10:41:13.187 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:41:13.190 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:41:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2024-03-24T10:41:13.209 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:41:13.210 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-24T10:41:13.210 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +343us[ +343us] +/- 77ms 2024-03-24T10:41:13.210 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -395us[ -375us] +/- 57ms 2024-03-24T10:41:13.210 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +208us[ +228us] +/- 80ms 2024-03-24T10:41:13.210 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:41:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +359us[ +359us] +/- 77ms 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -391us[ -355us] +/- 57ms 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +218us[ +218us] +/- 80ms 2024-03-24T10:41:13.240 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:41:13.241 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-24T10:41:13.251 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-24T10:41:13.251 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-24T10:41:13.260 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-24T10:41:13.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:41:13.278 INFO:teuthology.orchestra.run.smithi073.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: File exists 2024-03-24T10:41:13.279 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2024-03-24T10:41:13.280 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-24T10:41:13.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-24T10:41:13.298 INFO:teuthology.task.internal:Duration was 720.335068 seconds 2024-03-24T10:41:13.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-24T10:41:13.309 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-24T10:41:13.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-24T10:41:13.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-24T10:41:13.366 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:41:13.433 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:41:13.825 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-24T10:41:13.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-03-24T10:41:13.826 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-24T10:41:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2024-03-24T10:41:13.850 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-03-24T10:41:13.850 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-24T10:41:13.907 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-24T10:41:13.907 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-24T10:41:13.910 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-24T10:41:13.992 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-24T10:41:13.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-24T10:41:13.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-24T10:41:14.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-24T10:41:14.116 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-24T10:41:14.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-24T10:41:14.143 INFO:teuthology.orchestra.run.smithi073.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2024-03-24T10:41:14.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:41:14.144 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2024-03-24T10:41:14.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-24T10:41:14.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-24T10:41:14.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-24T10:41:14.210 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-03-24T10:41:14.221 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2024-03-24T10:41:14.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:41:14.223 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2024-03-24T10:41:14.224 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2024-03-24T10:41:14.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-24T10:41:14.234 INFO:teuthology.task.internal:Transferring archived files... 2024-03-24T10:41:14.235 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi073 2024-03-24T10:41:14.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-24T10:41:14.251 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-03-24T10:41:14.298 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066/remote/smithi078 2024-03-24T10:41:14.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-24T10:41:14.371 INFO:teuthology.task.internal:Removing archive directory... 2024-03-24T10:41:14.371 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-24T10:41:14.373 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-24T10:41:14.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-24T10:41:14.428 INFO:teuthology.task.internal:Not uploading archives. 2024-03-24T10:41:14.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-24T10:41:14.438 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-24T10:41:14.438 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-24T10:41:14.440 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-24T10:41:14.455 INFO:teuthology.orchestra.run.smithi073.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 24 10:41 /home/ubuntu/cephtest 2024-03-24T10:41:14.501 INFO:teuthology.orchestra.run.smithi078.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 24 10:41 /home/ubuntu/cephtest 2024-03-24T10:41:14.504 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-24T10:41:14.514 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-24T10:41:14.525 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi073 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2024-03-24T10:41:14.525 INFO:teuthology.nuke:Checking targets against current locks 2024-03-24T10:41:14.550 DEBUG:teuthology.nuke:shortname: smithi073 2024-03-24T10:41:14.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T10:41:14.575 DEBUG:teuthology.nuke:shortname: smithi078 2024-03-24T10:41:14.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T10:41:14.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.530637', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqk9dATlwXy+rpqjN9Zyphqkl/rDchGeil0qHop71DGM9B989yvP/j18Vi+8MqKL+Rop/wRYfvol2AzB2Tg1k='} 2024-03-24T10:41:14.598 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.532290', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWTV2diAXT+1yBgPlwwayXBRwwHcaQB0sLIXPCoYIUakDfA6u5A1a9ASmgoVG0TpRRKyUf9YeXhqnFR1Q1zqCM='} 2024-03-24T10:41:14.628 INFO:teuthology.orchestra.console.smithi073:Power off 2024-03-24T10:41:14.628 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:41:14.645 INFO:teuthology.orchestra.console.smithi078:Power off 2024-03-24T10:41:14.645 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:41:14.654 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-03-24T10:41:14.654 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:14.667 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-03-24T10:41:14.667 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:14.678 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-24T10:41:14.690 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-24T10:41:18.679 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:18.690 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:18.788 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-24T10:41:18.799 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-24T10:41:22.790 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:22.800 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:22.901 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-03-24T10:41:22.909 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-24T10:41:23.002 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-03-24T10:41:26.912 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:41:27.022 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-03-24T10:41:27.122 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-03-24T10:41:27.227 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} duration: 720.3350677490234 failure_reason: 'Command failed on smithi073 with status 1: ''mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log''' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-03-24T10:41:27.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:41:27.401 INFO:teuthology.run:FAIL